10 Commits (d0e9bf565b1227857ecb4f3f308dc6cc5535ace6)

Author	SHA1	Message	Date
Erik de Vries	54dfb6a8ca	actorizer: major fix to ud parsing, changed regex to remove html tags to only include tags with a maximum of 20 characters in them ... ud_update: major fix to ud parsing, changed regex to remove html tags to only include tags with a maximum of 20 characters in them elastic_update: set the minimum break between retries from 10 to 30 seconds elasticizer: implementation of retries for elasticizer function, 10 retries with a break of 30 seconds in between	6 years ago
Erik de Vries	39005c7518	elasticizer: Updated bulk size to 1024 (a power of 2) and set a timeout of 900s every 500000 updates ... query_gen_actors: Added an additional generator for the "Institution" type (for EU support) actorizer: Created an updater function to search for actors and use UDPipe to parse the results	6 years ago
Erik de Vries	a3c3651c79	elasticizer: updated scroll time to be longer than the timeouts every 200000 articles (so 20m scroll time, 900s (15m) timeout)	6 years ago
Erik de Vries	4ad5357e15	elasticizer: Added 900s timeout after every batch of 200000 articles when updating, to allow ES to do some segment merges (and clean up disk space)	6 years ago
Erik de Vries	f543d658bd	Major overhaul to ES bulk update integration. Added support for both setting and appending to variables	6 years ago
Erik de Vries	11d8b31c60	Added generic actor search query generator. Updated elasticizer and elastic_update to connect either to the remote server, or a local ES instance	6 years ago
Erik de Vries	d203de0b2a	Updated elasticizer docs, created modelizer and class_update functions	6 years ago
Erik de Vries	217ee76568	V 0.1 for elasticizer function with updater support	6 years ago
Erik de Vries	a273524105	Added support for custom update function to elasticizer	6 years ago
Erik de Vries	4bbe84ab83	First release of mamlr package	6 years ago