Scheduled Maintenance: We are aware of an issue with Google, AOL, and Yahoo services as email providers which are blocking new registrations. We are trying to fix the issue and we have several internal and external support tickets in process to resolve the issue. Please see: viewtopic.php?t=158230

 

 

 

A program for searching files by content.

Off-Topic discussions about science, technology, and non Debian specific topics.
Post Reply
Message
Author
frank38
Posts: 114
Joined: 2017-10-30 12:04

A program for searching files by content.

#1 Post by frank38 »

I'm developing a program for searching files by content.
At the moment the half, harder work is done.
Below is a picture of the current frontend:

Image

The features are:
- extractors as plugins
- language support (in the picture is in italian)
- support for multiple databases
- sqlite3 support
- preferences
- keep all very simple.

Some suggestions, also for the name of the applications?
Last edited by frank38 on 2018-01-31 09:14, edited 3 times in total.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files for content (wip).

#2 Post by frank38 »

Well, the program is going on very well.
As I already wrote, extractors for all type of files can be written (a couple of words to change) and added (just put them in the related folder) very easily, they are plugins.
User interface can be translated in every languages.
It is usable in the main part.
Last edited by frank38 on 2017-12-11 11:53, edited 1 time in total.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files for content (wip).

#3 Post by frank38 »

... and no daemon.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files for content (wip).

#4 Post by frank38 »

I think I can upload a pre-release, full working.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files for content (wip).

#5 Post by frank38 »

I've uploaded the program:

https://www.mediafire.com/file/dugimnnd ... -+V0.1.zip
md5sum: e17bf3232003620bae51a83389195105

... and a screenshot of the window that inform us about the plugins status
(at least, the plugin etext.py never will be disabled):

Image

Just some final words:
- the first steps are: execute the program Gsearcher.py, open the configurator window from the menu and choose some folders (I've added some in the 'files and other' folder for testing) with files to index in, and check which plugins are enabled, which plugins have been disabled and the reason; then start indexing; to try some query re-execute the program.

I'd like to know what do you think.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#6 Post by frank38 »

I've added a little routine to filter the results showed in the notebook to limit the number of tabs: because each preview is about 400 chars long, it is possible to limit them in some circustances.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#7 Post by frank38 »

Since the first upload, which was only a little preview:
- a filter to discharge useless tabs
- the searched words are now highlighted in the preview: they are in bold
- the button 'open' launches a filemanager and opens it in the selected folder; a
custom filemanager can be setted
- added an icon to the program
- added a description about the file handled by each plugin
- implemented more things under the hood
- I've been working on adding the ability to create and choose different databases
- the program will have a log file
- optimization.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#8 Post by frank38 »

Well, I think I can upload a new testing version soon. Almost complete, only to get some suggestions.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#9 Post by frank38 »

The link of the version 0.2 (still testing) :

http://www.mediafire.com/file/4jzas5e0b ... _V_0.2.zip

md5sum: faf22e3ce6394dc4d6e65e6ee6e1bf9b

It's almost complete but it is still in dev stage.
I'd like to know some suggestions, as well if the English translation is good.
In the zip file also some sample files ready to be indexed.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#10 Post by frank38 »

Added further things:
- metadata support (optional)
- more code...

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#11 Post by frank38 »

I've uploaded the third preview of the program:

http://www.mediafire.com/file/ea4ihd33t ... _V_0.3.zip

md5sum: a57e25304dffb725e8a68a2e86b01b06

The program is almost complete, only little things to complete.
Each plugin can retrieve metadata if Exiftool is already installed and found, but it is optional. I suggest to use exiftool.
In the query/main window a tab for metadata has been added; a query by metadata is also possible.
I think I can complete the program in one, two weeks.

Some suggestions?

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#12 Post by frank38 »

This is a pre-final release of the program:

http://www.mediafire.com/file/3k03nlc8d ... er-0.9.zip
md5sum: 5ffdf94786c704d16e9619178053eadf

Added: apart metadata, each file can have a single personal tag.
Querying is now possible by words and metadata/tag.

Some sample files (with metadata) ready to be indexed are still provided.

No more changes will be made, this release could be identical to the final release.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#13 Post by frank38 »

Just an update version:
http://www.mediafire.com/file/ikclbzqqd ... r-0.91.zip
md5sum: 91ea8bddf04348e32d3b62ef709ad234

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content (wip).

#14 Post by frank38 »

Final version 0.92:
http://www.mediafire.com/file/i1aw6wqq3 ... r-0.92.zip
md5sum: 690896c3c2e46a51112021fedcb6deda

Changelog:
- press return to start indexing
- other little changes

The program will never reach version 1 due to an issue with the sqlite program:
if a document contains characters with accent, the abstracts are truncated by the amount of them, if there are any before the searched word. This issue doesn't affect the query. The workaround is to use the methon .replace() at line 198 of the indexerdb.py file, e.g. .replace("à","a").

User avatar
pawRoot
Posts: 603
Joined: 2016-12-28 18:26
Has thanked: 1 time
Been thanked: 1 time

Re: A program for searching files by content.

#15 Post by pawRoot »

Why don't you use something like GitHub?

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content.

#16 Post by frank38 »

pawRoot wrote:Why don't you use something like GitHub?
I'm making applications for my personal use, but I share them with everybody.
I'm quite well here.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content.

#17 Post by frank38 »

Here is the version 0.99 of my program:
http://www.mediafire.com/file/92tdfozyp ... r-0.99.zip
md5sum: 62aa0cc0bd53f476257a0d8c1e078323

The issue of the previous release has been solved.
Read the readme for more infos.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content.

#18 Post by frank38 »

Final version of Gsearcher (version 1.0):
http://www.mediafire.com/file/21m17zoro ... er-1.0.zip
md5sum: 6d6573ae43a8f1b579625201c15bbc6f

Changelog:
- more room at the beginning of each tab after the query, if possible;
- searched words are highlighted no more.

frank38
Posts: 114
Joined: 2017-10-30 12:04

Re: A program for searching files by content.

#19 Post by frank38 »

A new version:

http://www.mediafire.com/file/6f8710nik ... -1.0.1.tar
Md5sum: 94f0b20a7074abb5493dedd41aaa9f9e

Changelog:
- searched words are highlighted in the previews;
- added an option to change the previous behaviour (read the Readme).

Post Reply