We are looking for a Data Engineer to build the pipelines storage and retrieval systems behind a data platform that helps AI agents produce better forecasts. The mandatory requirements are 5+ years of experience with Python software engineering strong SQL database and data modeling skills production ingestion pipelines unstructured data processing and RAG vector databases or vector search and an upper-intermediate English level.
Build reliable ingestion pipelines. Acquire and process diverse datasets handling incremental updates deduplication schema changes retries backfills and monitoring. Design the data platform. Develop storage and indexing architectures that support SQL queries keyword and vector search and graph-based retrieval. Make data useful to AI agents. Build document processing chunking embedding and retrieval pipelines that deliver relevant context quickly and efficiently. Support historical reasoning and evaluation. Implement bitemporal models and point-in-time queries that distinguish when something happened from when it became known preventing future information from leaking into historical tests. Own data quality and provenance. Define schemas validation rules source attribution lineage and timestamp semantics. Investigate inconsistencies and make …
Sign In to ViewRemote Brazil
Remote Canada
Remote Brazil
Remote
Remote
Remote United States
Unlock: Sign Up for free / Sign In and use the searches from your home page or the links in the footer.