13 Commits (9e433ecf9e0a323b2596aa290d7e53cee3f2aadd)

Author	SHA1	Message	Date
Erik de Vries	1a4ba19546	actorizer: Removed udmodel dependencies, commented code, changed nested lists to flat lists ... bulk_writer: changed handling of single-row dataframe parsing to JSON elastic_update: changed function to return instead of print appData on error ud_update: Changed nested lists to flat lists, and added start and end character positions	6 years ago
Erik de Vries	41c86ea116	actorizer, ud_update: Updated ud parsing and actorizer to work based on character positions. This code is used for local testing	6 years ago
Erik de Vries	34531b0da8	out_parser: added option to clean output using regex to remove numbers and non-words ... dfm_gen, ud_update: updated functions to make use of out_parser cleaning option merger: updated regex for cleaning lemmatized output	6 years ago
Erik de Vries	0a3bdb630b	actorizer, dfm_gen, ud_update: unified output parsing from _source and highlight fields into a single function (out_parser) ... out_parser: function to parse raw text output into a single field, either from _source or highlight fields dupe_detect: updated function to use 'ver' parameter for versioning	6 years ago
Erik de Vries	9e5a1e3354	ud_update: removed mc.preschedule = F	6 years ago
Erik de Vries	c7560d7e32	ud_update: Removed . at end of text, and added mc.preschedule = F for testing	6 years ago
Erik de Vries	37df81b8ff	ud_update: fixed merged output field to always contain an (extra) dot (period) at the end of the document	6 years ago
Erik de Vries	c32c9e5ad3	ud_update: fix to deal with non-existing column names	6 years ago
Erik de Vries	8ffbddc073	actorizer, ud_update: implemented 'ver' variable for keeping track of updates	6 years ago
Erik de Vries	ae23456736	actorizer, ud_update: Updated merging of document fields to properly deal with missing punctuation at the end of fields (e.g. a title without punctuation at the end of the string) ... modelizer: Minor update to feature keyness, using absolute values now to determine the most informative features for a class (so features that are either strongly postively or negatively related to the class) bulk_writer: Added the 'ver' parameter to include a short version string with each update. Mostly to deal with updates that do not complete successfully on all data	6 years ago
Erik de Vries	54dfb6a8ca	actorizer: major fix to ud parsing, changed regex to remove html tags to only include tags with a maximum of 20 characters in them ... ud_update: major fix to ud parsing, changed regex to remove html tags to only include tags with a maximum of 20 characters in them elastic_update: set the minimum break between retries from 10 to 30 seconds elasticizer: implementation of retries for elasticizer function, 10 retries with a break of 30 seconds in between	6 years ago
Erik de Vries	34a6adf64e	changed udpipe output variable from tokens to ud	6 years ago
Erik de Vries	061da17c2a	ud_update: Added function to lemmatize documents	6 years ago