15 Commits (2944039f73a2d0e22663e9641205a8eee6b59307)

Author	SHA1	Message	Date
Your Name	4fd9222a2d	lemma_writer: updated to write metadata csv when dumping documents in ud format ... out_parser: fix for generating empty columns	4 years ago
Your Name	3cdb68b196	out_parser: updated fncols function	4 years ago
Your Name	77eb51a1bf	actorizer: totally revamped way of finding actors ... elasticizer: updated dump handling to create a dump for every batch, instead of one big file at the end out_parser: streamlined code query_gen_actors: only include relevant fields ud_update: changed function parameters to work with elasticizer dump function	4 years ago
Your Name	5d99ec9509	elasticizer: added option to dump data frames to rds files ... out_parser: changed to single core, due to performance increase sentencizer: corrected documentation for sent_dict parameter	4 years ago
Your Name	a3b6e19646	revised modeling pipeline: ... cv_generator: generate folds for nested cv dfm_gen: added optional lowercasing parameter estimator: estimate model and performance based on parameters feat_select: select features based on textstat_keyness metric_gen: convert output from estimator to model performance metrics modelizer: updated for new pipeline modelizer_old: old model pipeline out_parser: now correctly exported	5 years ago
Erik de Vries	060751237b	actorizer, out_parser: switched from mclapply to future_lapply and removed windows-specific code from out_parser ... query_gen_actors: rewritten minister queries to only use proximity queries	5 years ago
Erik de Vries	8051a81b66	actorizer, dfm_gen, modelizer, out_parser: replaced all instances of detectCores by cores parameter (which defaults to detectCores)	5 years ago
Erik de Vries	90fdbcc982	out_parser: parallelized when not in windoze	6 years ago
Erik de Vries	522c872dba	out_parser: moved cleaning regex to end of pipeline, to prevent collissions with other (mandatory) regex cleaning	6 years ago
Erik de Vries	e70b6ccf7a	actorizer: fixed sentence_count and out_parser calls ... out_parser: Added comment with old regex	6 years ago
Erik de Vries	ce5f812252	dfm_gen, merger: Added option for generating lemma_upos hybrids for merged field ... merger: Added custom clean option (sometimes not cleaning is preferred, even with lemmas) merger, out_parser: Updated regex for filtering out non-words to also include email addresses (containing both @ and .)	6 years ago
Erik de Vries	1955692346	dfm_gen, out_parser: updated documentation ... dupe_detect: major fix to function, no longer using rownames for article ids	6 years ago
Erik de Vries	34531b0da8	out_parser: added option to clean output using regex to remove numbers and non-words ... dfm_gen, ud_update: updated functions to make use of out_parser cleaning option merger: updated regex for cleaning lemmatized output	6 years ago
Erik de Vries	d0e9bf565b	dupe_detect: Reset the _delete value to 1 ... out_parser: fix to sentence parsing, add additional (empty) string at end of merged field, to make merged field end on .	6 years ago
Erik de Vries	0a3bdb630b	actorizer, dfm_gen, ud_update: unified output parsing from _source and highlight fields into a single function (out_parser) ... out_parser: function to parse raw text output into a single field, either from _source or highlight fields dupe_detect: updated function to use 'ver' parameter for versioning	6 years ago