Shop Mobile More Submit  Join Login
Dev_Note_Search2 by Dediggefedde Dev_Note_Search2 by Dediggefedde
With this userscript, you can search within your notes.
After indexed, searching is finished within seconds.

How to install:


Link: phi.pf-control.de/userscripts/…
This script will work in

  •    Firefox + Greasemonkey
  •    Chrome + Tampermoneky
  •    Opera + Violentmonkey
  •    Safari + Tampermonkey

For a detailed instruction, see my manual:
dediggefedde.deviantart.com/jo…

How to use


After you installed the script, the "Search"-Tab should appear within your Notes-menu.
Clicking it will make the search form appear.
On the first time there should be the text
'No notes fetched so far! Press "Index Notes"! '
on the far right.

Click "Index Notes" for a full scan of the currently selected folder! This may take a little time (Firefox: around 70 Notes/s, Chrome around 90 Notes/s; e.g. 380 Notes in Firefox takes around 5s)

You can break indexing by leaving the site any time! The script will ask you on your next visit, if it should continue indexing.

If you already have your Notes indexed, you can click on "Check Notes" to add all notes cou got since the last scan.

Now you are ready to search by inserting text into the search fields and press enter or the "Search" button.
For a more detailed explaination how to search, so the "How to search" section!

Clicking on a search result will show you the regarding Note! If you want to mark or delete it, please use the buttons at the bottom of the note!

You can also click on the result's header to sort through the results! Another click will revert the order.

Please Note that the Date will be displayed according to your computer's language-setting (for me that's German, so I got a Mittwoch instead of Wednesday).

How to search


Searching Title/Author and Text works slightly different:

Title/Author:
If you type single words, they will be searched OR connected. That means
Title: contest help
Will search all Notes where there is contest OR help within the Title.
Capital letters are treated like smaller ones.
The words themselves are a CONTAIN request: Notes like flowercontest or contesthelp will also match.

Text:
Searching in Text is a FULLWORD search: contest will only match my little contest here and not contesthelp or "flowercontest".

To change that, there are a couple of operators: - + " *.

To make it a CONTAIN-Search, you can simple add a * at the end or the beginning of a word:
contest* will match contest as well as contesthelp. *test* will match contest as well as testresult or contestresult.

Making a group of words AND connected, just prepend a + before the word:
+contest +result will only match Notes that contain contest AND result
Adding words without a + will add their matches to the AND-result:
+contest flower +result will match notes that only contain contest AND result, but also Notes with flower

The NOT-Operator is easy to understand: prepend a - and matching results won't be shown.
contest -flower will show all Notes with contest but only if they don't contain flower!

Quotes can be used to protect spaces/word groups.
"flower contest" will match only Notes that actually contain flower contest.
This will internally first search without quotes and then make a fulltext-check to remove unwanted notes.
That's why you some results for quote-searches will vanish after a second.

Combining will work like this:
+"flower *test*" +*result -help "no concern"
This will match Notes that have something like flower contesthelp AND testresult within them, but not help! contesthelp is fine as the help is not alone here. additionally Notes where no concern is part of will also be shown.

But I guess in most cases, single word searches or using + and * will be fine for you.

Thanks goes to


  • You of course! I keep wanting to use my scripts and I keep on getting requests to repair the old version of this script!
  • zio-san had a really nice idea how to improve the data-structure to index notes! As Browsers are limitting stored values to 5 Mbyte, I had to think of a ncie solution here. With making a list of words pointing to the containing note-ids, 500 Notes only take around 200 kbyte, increasing better than linear...
  • ChinZaPep and NightsCrimson for spontan beta-testing: I wrote the script within 3 days and had another 5 days beta-testing with a lot of updates.^^

Update-Log


2013-10-26, v1.00: script published
Add a Comment:
 
:iconlannad:
LannaD Featured By Owner Jul 21, 2016  Hobbyist Digital Artist
Congrats on making this. It is definitely better than the official note search.

Sadly, it seems that it stopped working after an update (Ubuntu-Firefox-Greasemonkey combo). Greasemonkey still shows the script when I visit my notes page, but the "search" tab is gone. Too bad, since it worked almost perfectly (it would refuse to index notes a couple of times, but after a couple of tried, it all went smoothly) for so long.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jul 21, 2016
Hi! Thanks for the report!
I had some time to look into it now and there seemed to be a typo...
Please try out the current version 1.1.17 and tell me if it is working now!
Reply
:iconlannad:
LannaD Featured By Owner Jul 21, 2016  Hobbyist Digital Artist
Sadly, it is still not showing up, even after I restarted my browser. Should I alsom restart my system and delete cookies? Maybe reinstall Greasemoneky, as well?
Reply
:iconsigurdhosenfeld:
SigurdHosenfeld Featured By Owner Jun 13, 2016
This extension is essential, and far, far better than the in-built note search! With this I can search within all my notes, even from 10 years ago. It's incredibly useful, wish I knew about it earlier. Well done. :star:
Reply
:iconbootsii:
Bootsii Featured By Owner Jun 6, 2016  Hobbyist Digital Artist
Ich versuche "commission" im Text aber ich sehe keine Notes. Ich weiß, ich habe viele mit dieses Word?
Entschuldiging 
für mein Deutsch, es ist nicht so gut im Moment 8( ich nehme Kurse
i.gyazo.com/433f30093b448a5d52…
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jun 7, 2016
Hi! Thanks for your report!
I can reproduce the error and try to fix it.
Untill then, if you add a * after your word, it seems to work properly ("commission*").
--------
Hi! Danke für deinen Bericht!
Ich kann den Fehler reproduzieren und versuche ihn zu beheben.
Bis dahin funktioniert es wohl korrekt, wenn du ein * hinter das Suchwort schreibst ("commission*").
Reply
:iconbootsii:
Bootsii Featured By Owner Jun 7, 2016  Hobbyist Digital Artist
Danke schön!
Aber wann ich versuche "commission*" zu schreiben, es ist auch funktioniert nicht :x
orig12.deviantart.net/4b7b/f/2…
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jun 7, 2016
Mmh... Sorry that it doesn't work...
It seems to work for me at the moment...
However, it is supposed to work without * anyway, so I will work on a solution. ^^
-----
Mmh... Schade, dass es so nicht für dich klappt...
Für mich scheint so so zu gehen...
Es sollte aber sowieso auch ohne * funktionieren,  daher arbeite ich eh an einer Lösung. ^^
Reply
:iconbootsii:
Bootsii Featured By Owner Edited Jun 8, 2016  Hobbyist Digital Artist
Meinst du, es ist etwas mit Chrome oder Tampermonkey? Denn wenn ich installiere es "404'd" :XD:
Ich werde versuchen deinstallieren und reinstallieren, dann berichten zurück ^^
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jul 21, 2016
Hi! I found a bug today that might have caused your reported problem.
Would you mind testing the current version 1.1.17 to see if it is working now?
Reply
:iconbootsii:
Bootsii Featured By Owner Jul 27, 2016  Hobbyist Digital Artist
Should I download it again or is it automatically updated?
Usernames seem to be working, but still no use when entering "commission" ^^;
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jul 27, 2016
I don't know the interval and if it is checked automatically at the moment at all for updates...
best bet is to install it again and refresh the page.
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Mar 12, 2016  Hobbyist Digital Artist
Well now that DA has it's official note search thing, I'm still going to use this because the official one can only go back to 2016-2015.

And this one can only travel back to 2013-2012, 2014 is still stuck in limbo I guess :shrug:
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Mar 12, 2016
Yes, I remember your last report.
I still guess that there is some amount of character limitation or a strange character that stops the reading out...
The main problem here is/was, that I only have about 500 note since 2010. And for me the script is working for all of them.
If you want to try something out again, I could try throwing some try{}catches around me inside the script, so it might not simply abort the scan...

In principle writing a userscript and loading the data into the client storage is the wrong attempt in the first place...
Maybe I consider writing an archive application than can use the local filesystem... Things like tags, mixed history and non-exclusive groups are still not part of dA-Note system and might come in handy for commissions...
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Mar 12, 2016  Hobbyist Digital Artist
Yeah, you could try that.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Mar 13, 2016
Hi again!

I was taking another look at the code and added some lines to make the code more stable.
If you want to give it another try, update to version 1.1.16!
I tried that version in Firefox Greasemonkey and Chrome Tamermonkey and both work for me...
In case there is an error, there should now also be a more informing message in the console.
(console in firefox/chrome: press ctrl+shift+j)

Regarding the idea of writing a client application that downloads the notes and makes them searchable/organizable on hard drive...
... Would that be something that you use?
What features are you missing right now (e.g. conversation-history, tags etc.)?
What platform would you use this on (desktop/smartphone, win/linux/android etc.) ?
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Mar 13, 2016  Hobbyist Digital Artist
How do I update to version 1.1.16?
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Mar 13, 2016
Just install it again from the install link.
It won't overwrite your old data and you don't have to restart your browser, just refresh the page after updating.
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Mar 13, 2016  Hobbyist Digital Artist
Well, for starters I got at least a thousand more notes out of the 26,227.

But there is a major problem, it won't index any text, just username and subject.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Jul 21, 2016
Hello again!
Today I found a bug that might have caused the problem you reported.
Would you mind giving version 1.1.17 a try again?
Reply
(1 Reply)
:icondediggefedde:
Dediggefedde Featured By Owner Mar 14, 2016
I took a look into it today again...
There I noticed the search for content doesn't work for exact word fits... however, if you search with a placeholder like "chocolate*" it fill find chocolate again...
There also seems to be a problem with sorting... sorting looks more like random shufling at the moment.
I will try to fix this the coming days...
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Mar 14, 2016
Are you sure? clicking the notes should still yield the full note.
Searching for a word is always searching for the full word, e.g. searching for "choc" will not hit notes with "chocolate".
Instead use * as a placeholder to let "choc*" match "chocolate"...
Maybe try the "reset to default" button first before indexing again.
I will take a look into it today again, though yesterday it seem to work fine for me...
Reply
:icontessary:
tessary Featured By Owner Nov 20, 2015  Student Digital Artist
THANK YOU SO MUCH
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 21, 2015
You're welcome^^
Reply
:icongalaxydrug:
galaxydrug Featured By Owner Nov 20, 2015
bless your soul
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 21, 2015
Thank you ^^
Reply
:iconsentimentalfreak:
sentimentalfreak Featured By Owner Nov 19, 2015
Awesome. Is there a way to download all the notes once they are indexed?
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 19, 2015
No, that is not possible.
That would also require a different script because my script isn't storing the notes in plain text.

Tech: The required storage would be at least 1 byte per character and with the maximum size limit in Firefox etc. of ~5MB, this would limit the index to 5000000 characters. With quotes etc. e.g. an average note size of 2500 characters would limit the search to 2000 notes. This was the reason especially commercial artists and deviants with longer notes (e.g. many quotes or community work) complained about the script stopping to index after some thousand notes... It was also pretty slow.
Now I'm storing an word-index. Each word gets information in which notes it is used. only if you search for a specific order of words using quotation marks ("first second third") will those notes, which contain each of the words somewhere, be loaded again from dA to make a full text search to make sure of the words' positions.
Reply
:iconsentimentalfreak:
sentimentalfreak Featured By Owner Nov 19, 2015
Thank you for the reply. The search script is amazingly useful and fills a gap that DA have been slow to fill or had it as a low priority.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 21, 2015
By the way: If there would be a download-way, which output-format would you prefer?
I worked a bit with javascript's .zip generation, but also with .pdf generation...
So, I could imagine:
output 1 file with all notes OR output 1 filer per note and putting them in a .zip file
output into a .txt file in HTML code OR in .txt in a customized Code (dropping format and replacing img and links with their urls) OR in a .pdf file

what are your ideas regarding this?
Reply
:iconsentimentalfreak:
sentimentalfreak Featured By Owner Nov 22, 2015
Thanks for your thought on the issue but I'm sure your time could be better spent on more useful things that would help more people :)
Reply
:iconprofessionalperv-69:
professionalperv-69 Featured By Owner Nov 12, 2015  Hobbyist Digital Artist
It doesn't seem to work for me anymore. The search would always fail after the first bar update, just locking up. After I hit reset to default, the option totally vanished. I tried refreshing, I tried logging out and back in, I tried uninstalling and reinstalling. Nothing worked.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 12, 2015
Thanks for your report!
This is mostly a chrome problem as it seems as I was using associative arrays and chrome seemed to protect certain keywords as they are handled as object members in javascript.
I replaced this by two mapping integer arrays and rewrote the affected code parts.
Please update to v1.1.15 and check again if it works! You might need to use the reset button and reindex your notes afterwards.
Reply
:iconshadow-guardian0:
Shadow-Guardian0 Featured By Owner Oct 26, 2015  Student General Artist
It says, "Apps, extensions, and user scrips cannot be aded from this website."

Why did this happen and how can I fix it?
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Oct 26, 2015
My guess is, you use google chrome and try to install this as an extension.
To protect users, google made a strong limitation to only let users install extensions from their store.
However, in this case, the script wouldn't work as a direct extension anyway.

To fix this, I recommend installing tampermonkey (chrome extension) first.
After that, you can install my script within tampermonkey (click the install link and follow tampermonkey's instruction).
Reply
:iconshadow-guardian0:
Shadow-Guardian0 Featured By Owner Oct 26, 2015  Student General Artist
I don't know what it was,but right after I posted it, I tried again and it works. Thanks.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Oct 26, 2015
You're welcome! ^^
I'm glad it's working for you now!
Reply
:iconshadow-guardian0:
Shadow-Guardian0 Featured By Owner Oct 26, 2015  Student General Artist
Thanks, and great tool!
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Oct 17, 2015  Hobbyist Digital Artist
This program has some strange problems.

It won't completely index all 24,907 notes I have, it gets up to something like 10,000 and the page crashes.

And it's only indexed the notes from 2012-2013.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Oct 17, 2015
Thanks for the report!
Such problems are always hard to reproduce as they don't appear on every checkup and I don't have enough notes to reproduce it...
have you tried to reindex it afterwards? maybe index a different folder first?
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Oct 17, 2015  Hobbyist Digital Artist
Well whenever I index any other folder, it stops at a certain amount of notes (which the folders have far less of them, 200 at the max)
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Oct 17, 2015
Have you tried the "reset to default" button or "refreshing" instead of "index notes"?
As you said, it only indexed notes from 2012-2013, I guess it only indexes the oldes notes...
Have you taken a look at the note where it stopped reading?
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Oct 17, 2015  Hobbyist Digital Artist
Well it stops at 7997 notes.

Resetting it to default basically just erase all the collected information and thus having to recollect all the notes, which it stops at 7997 out of 27000+
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Oct 18, 2015
Thank you for the information!
I wonder if it is a size limitation then...
I tried using a storage size saving method to store the information... Though I heard in Firefox indexedDB has no size limitation...
Just made a few tests but can't seem to find the issue here...
By the way, do you use Firefox and Greasemonkey on a Desktop-PC? Or Chrome and Tampermonkey? Or a different Browser?
Reply
:iconlegorulez49:
legorulez49 Featured By Owner Oct 18, 2015  Hobbyist Digital Artist
I am using Tampermonkey with Google Chrome.
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Nov 12, 2015
Hi again!
I noticed a problem on chrome with this script yesterday. certain keywords in notes would have rendered the associative array in the script buggy (e.g. "length").
I changed it now to 2 mapping and a normal arrays, so it might also fix your problem, if you update, reset the script's cache and index your notes again.
Reply
(1 Reply)
:iconleapardess:
leapardess Featured By Owner Sep 26, 2015
thank you so much! ♥
Reply
:iconnyaneo:
Nyaneo Featured By Owner Sep 16, 2015  Student Digital Artist
I LOVE YOU YOU SAVED MY LIFE ASDFASDFGFDSQAASSASSAAE
Reply
:icondediggefedde:
Dediggefedde Featured By Owner Sep 16, 2015
Thanks^^
I'm glad you like it ^^
Reply
:iconnyaneo:
Nyaneo Featured By Owner Sep 16, 2015  Student Digital Artist
No prob, I love it ^-^
This should be official
Reply
Add a Comment:
 
×





Details

Submitted on
October 26, 2013
Image Size
444 KB
Resolution
1261×1081
Link
Thumb
Embed

Stats

Views
5,395
Favourites
226 (who?)
Comments
186
×