171 Commits (b406304c80f7a013c457fb9967dc6ddd982b2355)

Author	SHA1	Message	Date
Erik de Vries	02b8a8c1da	dfm_gen & merger: Changed word cutoff point to be a general setting in dfm_gen. Cuts off at the last [.?!] before the cutoff point (so returns documents at a sentence, shorter than cutoff).	7 years ago
Erik de Vries	4a713ddc23	bulk_writer: setting names(x) <- NULL when there is only one value (list or otherwise) to be updated. ... This is because R apply treats rows of single values as a matrix, while it treats rows containing lists as (named) list. This has the nasty result of getting subvalues when using to JSON. i.e. computerCodes.actors = [list, of, ids] becomes computerCodes.actors.ids = [list, of, ids].	7 years ago
Erik de Vries	6bb8f9b635	class_update: added explicit httr::: references	7 years ago
Erik de Vries	f543d658bd	Major overhaul to ES bulk update integration. Added support for both setting and appending to variables	7 years ago
Erik de Vries	4adae2bbc6	Fixed bug in dupe_detect caused by switch from cutoff to cutoff_lower/upper	7 years ago
Erik de Vries	4cd46d1a5e	dupe_detect: added support for both lower and upper cutoff point	7 years ago
Erik de Vries	11d8b31c60	Added generic actor search query generator. Updated elasticizer and elastic_update to connect either to the remote server, or a local ES instance	7 years ago
Erik de Vries	3e66c7e1cd	Updated dfm_gen to have all topic vectors as numeric variables	7 years ago
Erik de Vries	adc4b3c639	Updated feature selection in modelizer function (see comment on lines 166/167)	7 years ago
Erik de Vries	65f8c26ec6	Renamed dupe_detect, and added return output	7 years ago
Erik de Vries	db418d7396	Add query_string function for generating query_string queries	7 years ago
Erik de Vries	d203de0b2a	Updated elasticizer docs, created modelizer and class_update functions	7 years ago
Erik de Vries	c815dc7f2b	Duplicate detection first commit	7 years ago
Erik de Vries	015411feaf	Added refresh=wait_for to bulk update url. This should make update scripts less demanding on the server side, because the server only replies after refreshing (happens every second)	7 years ago
Erik de Vries	413ad02a87	Set default to "lemmas" for dfm_gen	7 years ago
Erik de Vries	217ee76568	V 0.1 for elasticizer function with updater support	7 years ago
Erik de Vries	a273524105	Added support for custom update function to elasticizer	7 years ago
Erik de Vries	311838b34b	Updated dfm_gen to only create derivative codes if majorTopic actually exists, and set docvars to NULL when no majorTopic codes	7 years ago
Erik de Vries	dc4daf9de4	Added line to replace multiple whitespace characters in full text by a single regular whitespace	7 years ago
Erik de Vries	0e45c0f2d1	Added option for fulltext vs lemmas merged field	7 years ago
Erik de Vries	4bbe84ab83	First release of mamlr package	7 years ago