About Ragas Dataset Converter
An independent, single-purpose tool for moving RAG evaluation datasets between frameworks.
What this is
Ragas Dataset Converter is a small, free tool that converts RAG evaluation datasets between RAGAS, TruLens and LangSmith, and reports which RAGAS metrics a dataset can actually run. It exists because the same four columns — question, contexts, answer, reference — are named differently by every framework, and every rename is a silent breakage waiting to happen.
It is not a platform, an SDK or a service. There is no account, no dashboard and no roadmap.
Who maintains it
The tool is built and maintained by an independent developer. The project home — documentation, the field mapping reference and the issue tracker — is at github.com/kasthree/ragas-dataset-converter, and the author's other work is at github.com/kasthree. Bug reports and wrong field mappings go to the issue tracker there — a mapping that does not match the upstream schema is treated as a bug, not a feature request.
The application source is not published there. The tool ships as a client-side bundle, so its runtime behaviour is inspectable in any browser; the repository hosts the documentation and the issue tracker rather than the build.
Why it runs entirely in the browser
Evaluation datasets routinely contain internal documents, customer questions and unpublished product details. Uploading them to a third-party converter means handing that content to a server you do not control. This tool has no server: the conversion runs in the browser tab, and after the page loads there are no network requests. That is a design constraint, not a marketing line — the converter is a single JavaScript file with no dependencies and no analytics on the tool itself.
Where the field definitions come from
Every field name on this site is taken from the upstream projects rather than from tutorials: RAGAS documentation, ragas/dataset_schema.py, TruLens and LangSmith. Each reference page links to the exact upstream page it relies on.
How to report a problem
Open an issue at github.com/kasthree/ragas-dataset-converter/issues with the input JSON that misbehaves and the RAGAS version you target. Schema details are version-dependent, so the version matters more than the description.
Not affiliated
This is an independent project. It is not affiliated with, endorsed by, or supported by the Ragas, TruLens or LangSmith projects, or by any of their maintainers.