Commit Graph

169 Commits

Author SHA1 Message Date
ef9ab30372 shared: indexer: Add globbed pattern to ignore list
We added the wrong var previously... interestingly didn't matter.
2024-05-24 09:58:23 +02:00
1365772ba2 sqlitedbservice: Move to BEGIN IMMEDIATE TRANSACTION,finish queries 2024-05-24 09:58:23 +02:00
d4868f05fc sqlitedbservice: Only add non-empty outline entries 2024-05-24 09:58:23 +02:00
fc510b4376 sqlitedbservice,indexer: Add runWalCheckpoint() and call it after indexing 2024-05-24 09:58:23 +02:00
d85c0bd2a5 shared: document*.cpp: Fix type mismatch, causing problems in qt6 2024-05-24 09:58:23 +02:00
cfc64705e3 qt6: wildcardmatcher: use correct option for QRegularExpression::wildcardToRegularExpression() 2024-05-24 09:58:23 +02:00
6640504b49 Switch sqlite db to WAL mode 2024-05-24 09:58:23 +02:00
1e06ec5d69 tree: Move to Qt6 2024-05-24 09:58:23 +02:00
ff293b8505 shared: LooqsQuery: Add outline search filters 2024-05-24 09:58:23 +02:00
fcc3732917 shared: sqlitesearch: Begin outline search 2024-05-24 09:58:23 +02:00
4728001e7e shared: SqliteDbService: Add insertOutline(), Use DocumentProcessResult 2024-05-24 09:58:23 +02:00
d36a435195 shared: FileSaver: Use DocumentProcessResult 2024-05-24 09:58:23 +02:00
c5dff41df5 shared: token: Add FILTER_OUTLINE_CONTAINS 2024-05-24 09:58:23 +02:00
c6c0b09e56 PdfProcessor: Extract outline from documents 2024-05-24 09:58:23 +02:00
9a2ef19308 shared: processors: Use DocumentProcessResult instead of PageData vector 2024-05-24 09:58:23 +02:00
e68706b8d6 shared: Add DocumentProcessResult
This should be returned by processors
2024-05-24 09:58:23 +02:00
c5713f5839 shared: Introduce DocumentOutlineEntry 2023-05-14 14:06:24 +02:00
8550506517 migrations: Add 6.sql: Begin outline index 2023-05-14 14:05:26 +02:00
22fee1d064 shared: TokenType: FILTER_TAG_ASSIGNED is not a content search token 2023-05-07 17:11:31 +02:00
4c5643e342 cli,shared: Add remove, show and list for tags 2023-05-07 17:11:31 +02:00
4604970f9d shared: Indexer: Add setProgressReportThreshold() 2023-05-01 23:52:45 +02:00
6cd7a92576 shared: Indexer: Fix case where errors did not increase counter 2023-05-01 23:51:00 +02:00
94fbdb5a92 shared: sqlitesearch: Allow filtering by tags 2023-04-10 19:55:24 +02:00
abd1b94235 shared: LooqsQuery: Add tag:(),t:() filters to filter by tags 2023-04-10 19:55:24 +02:00
d2dcc2f95b shared: sqlitedbservice: Add setTags(),getTagsForPath(),getTags() 2023-04-10 19:55:24 +02:00
f324da0369 shared: Begin TagManager 2023-04-10 18:31:22 +02:00
a3cfb7ade1 shared: FileScanWorker: Catch LooqsGeneralException for better error msgs 2023-04-02 21:41:35 +02:00
4fe745e858 shared: sqlitedbservice: Begin addTag() 2023-04-02 21:41:35 +02:00
a0b95479e2 migrations: Add 5.sql: Tag support 2023-04-02 21:41:35 +02:00
32c2653b0f shared: FileSaver: addFile(): Consider fillExistingContentless 2023-04-02 21:41:35 +02:00
a869d677a3 shared: sqlitedbservice: Introduce exec(),execBool(). Refactor 2023-04-02 21:41:35 +02:00
0b829215e5 shared: LooqsQuery: Remove explicit copy constructor 2023-03-12 16:50:37 +01:00
566c4a8c58 tree: Resolve clang-tidy, clazy, compiler warnings 2023-03-12 16:50:25 +01:00
ccc4d09b36 shared: FilesSverOptions: Rename members 2023-01-08 17:37:28 +01:00
8298b675aa cli: CommandAdd: Implement --no-content and --fill-content 2023-01-08 17:37:28 +01:00
71789b5b56 shared: SqliteDbService: Add queryFileType() 2023-01-08 17:37:28 +01:00
4b1522b82a Introduce FileSaverOptions to consolidate common parameters 2023-01-08 17:37:28 +01:00
496aefaa09 shared: sqlitesearch: Remove unused var 2022-10-26 13:10:00 +02:00
c155d25a37 shared: sqlitesearch: Search trigram index too
Search the trigram index too, combining the results
with the results of the "normal" fts index.

Prioritize the latter since it makes more sense to
rank whole words higher.
2022-10-18 16:06:10 +02:00
583d5babf3 shared: sqlitedbservice: Insert to trigram index too 2022-10-18 16:05:19 +02:00
45659cdc59 shared: migrations: Add 4.sql: Begin trigram index 2022-10-18 16:04:00 +02:00
3022bbdfb5 sqlitesearch: escapeftsArgument: Fix wrong escaping of phrase queries 2022-10-02 19:55:10 +02:00
b6ac652ade shared: indexer: Report progress more often
Processing dirs with large docs takes time and waiting till the threshold
is reached can be a bit annoying in those cases, so report if last report
was 10+ seconds ago.
2022-09-23 20:08:00 +02:00
31f0568a87 shared: LimitQueue: Change limit type to int
More consistent with "QQueue::size()" and silences warning
2022-08-28 13:10:39 +02:00
10d61acbd0 shared,gui: SearchResult: remove page vector
Since the previous commit we don't group the results
anymore, making the vector redundant
2022-08-24 00:00:11 +02:00
eef0fae137 shared,gui,cli: Fix intra-file ordering for content search results
group_concat() does not preserve order of the ORDRE BY rank,
making the ordering quite meaningless for pages inside a file.

The recently introduced combobox to filter on a per file basis
should anyway be prefered than any kind of grouping in queries.

So we just remove the groupings here.

"All files" in the previews tab thus should show the best results
first now, from any files part of the result set.

A GUI option to sort by page instead of rank can be considered.
2022-08-23 23:44:47 +02:00
14730ed208 gui: mainwindow: Add vertical scroll option, default to it
Seems horizontal mode is too unusual according to multiple
feedback.

Allow choosing this the mode in the settings
2022-08-21 22:57:48 +02:00
0c1b57d911 mainwindow: Save/Restore history 2022-08-21 17:48:43 +02:00
c0f4087937 sqlitesearch: escapeFtsArgument: Fix handling of '*' prefix search
The * must not be in quotes
2022-08-21 07:55:49 +02:00
d900d58f26 shared: migrations: Add 3.sql: Drop potentailly harmful trigger
In [1] it's stated that "If the values "inserted" into the text
columns as part of a 'delete' command are not the same as those
currently stored within the table, the results may be unpredictable."

It's to be assumed only inserting ftsid is unpredictable. We
have no way for a proper delete because files are not immutable
or may have been deleted.

For now the index will contain entries for files that don't exist.
They won't appear in search results as they won't be joined
in the query.

[1] https://www.sqlite.org/fts5.html#the_delete_command
2022-08-14 20:24:21 +02:00