feat(corp/russian/data-import): new OpenCorpora data import tool

Adds the beginning of a tool which can import OpenCorpora data into a
SQLite database. This is quite a lot of toil and there's probably a
better way to do this, but overall becoming this intimately familiar
with the data structures is quite helpful for understanding what I
can/can't do with only this dataset.

Change-Id: Ieab33a8ce07ea4ac87917b9c8132226bbc6523b1
Reviewed-on: https://cl.tvl.fyi/c/depot/+/7859
Reviewed-by: tazjin <tazjin@tvl.su>
Tested-by: BuildkiteCI
This commit is contained in:
Vincent Ambo 2023-01-18 00:36:41 +03:00 committed by tazjin
parent 032ab16bbb
commit ee7616d956
6 changed files with 829 additions and 0 deletions

View file

@ -0,0 +1,16 @@
[package]
name = "data-import"
version = "0.1.0"
edition = "2021"
# See more keys and their definitions at https://doc.rust-lang.org/cargo/reference/manifest.html
[dependencies]
env_logger = "0.10.0"
log = "0.4.17"
rusqlite = "0.28"
xml-rs = "0.8"
[profile.release-with-debug]
inherits = "release"
debug = true