maurice/snix
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

feat(corp/russian/data-import): new OpenCorpora data import tool

Browse source 
Adds the beginning of a tool which can import OpenCorpora data into a
SQLite database. This is quite a lot of toil and there's probably a
better way to do this, but overall becoming this intimately familiar
with the data structures is quite helpful for understanding what I
can/can't do with only this dataset.

Change-Id: Ieab33a8ce07ea4ac87917b9c8132226bbc6523b1
Reviewed-on: https://cl.tvl.fyi/c/depot/+/7859
Reviewed-by: tazjin <tazjin@tvl.su>
Tested-by: BuildkiteCI
This commit is contained in:
Vincent Ambo 2023-01-18 00:36:41 +03:00 • committed by tazjin
parent 032ab16bbb
commit ee7616d956
6 changed files with 829 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
corp/russian/data-import/.gitignore vendored Normal file
View file

@ -0,0 +1,2 @@
target/
all_events.txt