657 thousand documents later: how we converted ALL of the DOF to Markdown
From 657,867 .doc files from Mexico's Official Journal of the Federation to clean Markdown: tools, results, and what's left to do.
DOF-RAG TeamRead more
#Markdown
3 postswith this tag
Four steps to process the DOF: conversion, cleanup, analysis and structure
From the downloaded WORD file to structured Markdown ready for embeddings: a walkthrough of our complete processing pipeline that includes LibreOffice conversion, custom LUA filters, Gemini image analysis, and a robust directory architecture.
DOF-RAG TeamRead more
The Battle of the Converters: Our Experience Extracting Text from the DOF
A comparative analysis of different tools for converting PDFs to markdown and why we chose Marker for our DOF-RAG project.
DOF-RAG TeamRead more