Data mining for random phrases
Tue 22 Mar 2016, 09:41 PMTweet
by Ben Langhinrichs
Every few years, our Midas LSX evolves to take on new challenges. Sometimes, those are challenges that seem obvious, such as exporting Notes data to HTML or JSON with high fidelity. Sometime, though, the challenges are not so obvious. Over the past year, we have been evolving the data export features to allow data mining, or selective extraction. While I could show lots of details, I thought I'd write a few posts showing different sorts of data extraction. All are done with the Export to CSV sample, and so require no "programming" even with LotusScript. For these, I'll generally use Tableau, an excellent data visualization tool, though honestly the output is a CSV file which could be analyzed in almost any software package.
For the first post, I thought I'd search for a specific phrase in rich text fields, although I will export more than just the phrase. Each row contains a text record along with the name and UNID of the documents, so if somebody mentions the phrase multiple times, there will be multiple rows. If there are no mentions, there are no rows created.
I did two simple charts, one for the phrase "rich text" and the other for the phrase "security". For both, I searched the Business Partner forum from 2004. (At the very bottom, you can see the Export Directive I used to get an idea how this works.)
The form I filled out for the "security" search is below.
Copyright © 2016 Genii Software Ltd.
What has been said: