Open Source · 2021

nodejs-file-reading — positional file ETL

Node.js engine for parsing fixed-width text files with hierarchical line types (parent/child) and persisting to Postgres (Sequelize) or MongoDB (Mongoose).

Solves the classic legacy-interchange problem: positional files where each line's first N characters select a different schema (header / lines / events) and records form a tree. Format is declared as a 'file mapping' (discriminator + per-line attributes), so adding a new format is config, not code.

Includes 4 versions (m41/m51/m80/m90) of a real banking/insurance message family, Postgres and MongoDB persistence variants, full Jest coverage on the core parser.

Stack

Node.js, Sequelize, PostgreSQL, Mongoose, MongoDB, Jest, Moment