Terms of Service

1 Acceptance of Terms

Your use of BeLLMark constitutes your acceptance of these Terms. Acceptance occurs at the earliest of: (a) downloading or cloning the BeLLMark repository; (b) completing a purchase of a commercial license; or (c) deploying or operating BeLLMark in any environment.

If you are using BeLLMark under the free non-commercial license, you additionally accept the PolyForm Noncommercial License 1.0.0 as incorporated herein by reference. If you have purchased a commercial license, these Terms govern your use in its entirety.

We reserve the right to update these Terms at any time. Continued use of BeLLMark after notice of updated Terms constitutes acceptance of the revised Terms.

2 Description of Service

BeLLMark is a self-hosted LLM benchmarking studio — a software application that you download and run on your own infrastructure. It enables you to:

• Compare one to six language models side-by-side using configurable evaluation criteria
• Conduct blind A/B/C evaluations where model identities are concealed during judging
• Score model outputs using other language models as automated judges (LLM-as-judge)
• Perform statistical analysis including confidence intervals, ELO ratings, and bias detection
• Export benchmark results in multiple formats (HTML, JSON, CSV, PPTX, PDF)

BeLLMark is distributed as source code (Python backend, JavaScript frontend) and as a Docker image. You are responsible for all infrastructure, hosting, compute costs, and any API costs incurred when connecting BeLLMark to third-party language model providers.

3 License Terms

3.1 Non-Commercial License (Free)

BeLLMark is available at no cost under the PolyForm Noncommercial License 1.0.0 for individuals and organizations whose use qualifies as non-commercial under that license. Non-commercial use includes personal projects, academic research, education, internal evaluation for non-commercial purposes, and open-source development.

Under the non-commercial license you may: use, copy, and modify BeLLMark for non-commercial purposes; run BeLLMark on your own hardware or private cloud infrastructure; and share modifications under the same license terms.

If you are uncertain whether your use qualifies as non-commercial, please contact us at [email protected] before using BeLLMark.

3.2 Commercial License

A commercial license is required if your use of BeLLMark is for commercial purposes, including (without limitation): internal use within a for-profit business, deploying BeLLMark as part of a commercial product or service pipeline, using BeLLMark to evaluate models powering a commercial application, or any use that does not qualify as non-commercial under the PolyForm Noncommercial License 1.0.0.

The commercial license is sold as a one-time purchase per legal entity. "Legal entity" means a single company, partnership, sole trader, or other legal organization as registered or recognized in its jurisdiction. A single purchase covers all employees, contractors, and systems operating under that legal entity.

Upon completion of a valid purchase, you receive a perpetual, irrevocable, non-exclusive, non-transferable license to use the version of BeLLMark available at the time of purchase, plus all future versions released during the license maintenance period (if any).

3.3 What the Commercial License Grants

• Use BeLLMark for any internal commercial purpose within your legal entity
• Deploy BeLLMark on unlimited machines, servers, or cloud instances owned or operated by your legal entity
• Modify BeLLMark source code for your own internal use
• Allow unlimited employees, contractors, and agents of your legal entity to access your BeLLMark instance

3.4 What the Commercial License Does Not Grant

• You may not redistribute, sublicense, sell, rent, lease, or otherwise transfer BeLLMark or your license rights to third parties
• You may not offer BeLLMark as a hosted or managed service to customers outside your legal entity
• You may not resell access to your BeLLMark instance
• You may not remove, obscure, or alter any copyright notices, license headers, or attribution notices embedded in BeLLMark
• You may not use BeLLMark in any way that violates applicable law
• Affiliates, subsidiaries, and parent companies that are separate legal entities require their own license unless otherwise agreed in writing

3.5 License Key and Verification

Upon purchase, you will receive a commercial license key or license certificate by email. You are responsible for safeguarding your license credentials. We reserve the right to verify license compliance upon reasonable request. Fraudulent use of license credentials constitutes a material breach of these Terms and will result in immediate license termination.

4 Payment Terms

4.1 Pricing

Commercial licenses are currently offered at an introductory price of €499 EUR per legal entity. The standard price is €799 EUR per legal entity. All prices are listed in Euros (EUR). The introductory pricing is available for a limited time and may change without notice for new purchases.

Price changes do not affect licenses that have already been purchased. Once you have completed a valid purchase, your license remains valid at the terms agreed at time of purchase, regardless of any subsequent price changes.

4.2 Merchant of Record

Payments for BeLLMark commercial licenses are processed by a third-party Merchant of Record (currently Creem, an Estonian-registered entity). The Merchant of Record acts as the seller of record for your purchase, handles payment processing, issues your receipt and invoice, and is responsible for applicable sales taxes and VAT collection and remittance in relevant jurisdictions.

By completing a purchase, you also agree to the Merchant of Record's own terms of service and privacy policy. We are not party to the payment processing agreement between you and the Merchant of Record, but we are responsible for delivering and supporting the Software license you have purchased.

4.3 Taxes

Prices displayed may be exclusive of applicable taxes. The Merchant of Record will calculate and collect any applicable VAT, GST, sales tax, or other taxes based on your billing location. For EU customers, prices may be displayed inclusive of VAT in accordance with applicable law. You are solely responsible for any taxes arising from your receipt of the license in your jurisdiction that are not collected by the Merchant of Record.

4.4 Purchase Confirmation

A purchase is confirmed when you receive a receipt and license delivery email from the Merchant of Record or from BeLLMark. In the event of any discrepancy, the Merchant of Record's payment records shall be authoritative for determining whether a valid purchase occurred.

5 Refund Policy

5.1 Eligibility

Refund requests are eligible if submitted within 30 calendar days of the original purchase date. After 30 days, BeLLMark commercial licenses are non-refundable. This is because the license is perpetual — you retain the right to use the licensed version of BeLLMark indefinitely even after the refund window closes.

There are no other eligibility conditions. You do not need to demonstrate a defect or provide a reason. We trust our customers to use this policy in good faith.

5.2 After the Refund Window

Refund requests received more than 30 days after the purchase date will not be honored, except where required by applicable mandatory consumer protection law. If you have an unresolved technical issue within the refund window, please contact support at [email protected] so we can assist you before you decide whether to request a refund.

5.3 License Upon Refund

Upon issuance of a refund, your commercial license is immediately terminated. You must cease all commercial use of BeLLMark and delete any deployed instances of the Software used under the commercial license. You may continue to use BeLLMark under the free non-commercial license if your use qualifies as non-commercial.

5.4 Chargebacks

If you initiate a payment dispute or chargeback with your bank or payment provider without first contacting us, we reserve the right to terminate your license immediately and contest the dispute. We encourage you to contact us first — we will resolve legitimate issues promptly.

6 Acceptable Use

You agree to use BeLLMark only in accordance with these Terms and all applicable laws and regulations. The following are expressly prohibited:

6.1 Prohibited Activities

• Reverse engineering for redistribution: You may not reverse engineer, decompile, or disassemble BeLLMark for the purpose of creating a competing product or commercially redistributing derived works
• Removing attribution: You may not remove, obscure, or modify any copyright notices, license headers, "Powered by BeLLMark" attribution text, or other proprietary notices embedded in or displayed by BeLLMark
• Unlawful use: You may not use BeLLMark to evaluate, develop, or improve language models intended for unlawful purposes, including generating illegal content, facilitating fraud, or violating the rights of others
• Circumventing license restrictions: You may not use BeLLMark in a manner designed to circumvent the per-entity license model, such as sharing a single license across multiple unrelated legal entities
• Impersonating or misrepresenting: You may not misrepresent your affiliation with BeLLMark or claim endorsement by the Developer without our express written permission
• Automated abuse: You may not use BeLLMark to conduct attacks on, or generate excessive load against, third-party API providers in violation of their terms of service

6.2 Your Responsibility for Outputs

BeLLMark is a tool for evaluating language model outputs. You are solely responsible for the prompts you submit, the model outputs you evaluate, and any decisions you make based on BeLLMark's analysis. The Developer is not responsible for the content generated by language models you connect to BeLLMark.

6.3 Third-Party API Terms

BeLLMark connects to third-party language model providers (such as OpenAI, Anthropic, Google, and others) using API keys that you provide. You are responsible for complying with the terms of service of any third-party providers you use with BeLLMark. We are not affiliated with and do not endorse any specific third-party model provider.

7 Intellectual Property

7.1 Developer's Rights

BeLLMark, including its source code, user interface, documentation, brand assets (the BeLLMark name, logo, and visual identity), and all intellectual property embodied therein, is owned by Maciej Rychlicki / Context Management and protected by copyright law, including the laws of Poland and applicable international treaties.

These Terms do not transfer any ownership of BeLLMark or its intellectual property to you. You receive only the limited license rights expressly stated in Section 3.

7.2 Your Data and Outputs

You retain full ownership of all data you input into BeLLMark, including benchmark prompts, test questions, model responses, evaluation results, and any reports or exports you generate. We make no claim to any content you create using BeLLMark.

Because BeLLMark is self-hosted, your data never leaves your infrastructure. We have no technical access to your BeLLMark instance, its database, or the data it processes.

7.3 Feedback

If you provide feedback, suggestions, or ideas about BeLLMark, you grant us a perpetual, irrevocable, royalty-free license to use such feedback for any purpose, including improving BeLLMark, without any obligation of compensation, attribution, or confidentiality. This does not affect your ownership of the feedback as intellectual property.

7.4 Open Source Components

BeLLMark incorporates open source software components. These components are governed by their respective open source licenses, which are included in the BeLLMark distribution and available in the source repository at github.com/Context-Management/BeLLMark. Your use of open source components is subject to the terms of those licenses.

8 Data and Privacy

8.1 Self-Hosted Architecture

BeLLMark is designed with privacy by default. Because it runs entirely on your own infrastructure, we have no access to the data you process with BeLLMark — including the prompts you use, the model responses you evaluate, your benchmark results, or your database contents. Your data remains under your exclusive control.

8.2 Data We Collect

We collect only the data necessary to process your purchase and provide customer support:

• Purchase data: Your name, email address, billing details, and transaction information, collected and processed by the Merchant of Record
• License data: Your email address and legal entity name, used to deliver and validate your license
• Support data: Information you voluntarily provide when contacting us at [email protected]
• Website analytics: Aggregate, anonymized usage data about our marketing website (bellmark.ai), not your BeLLMark instance

8.3 Privacy Policy

Our full Privacy Policy, which describes how we collect, use, store, and protect personal data in compliance with applicable law (including the GDPR), is available at bellmark.ai/privacy. The Privacy Policy is incorporated into these Terms by reference. In the event of conflict between these Terms and the Privacy Policy on matters of personal data processing, the Privacy Policy shall prevail.

8.4 Your GDPR Rights

If you are located in the European Economic Area, you have rights under the General Data Protection Regulation (GDPR) including the right to access, rectify, erase, restrict, and port your personal data. To exercise these rights, contact us at [email protected].

9 Disclaimer of Warranties

BELLMARK IS PROVIDED "AS IS" AND "AS AVAILABLE," WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, THE DEVELOPER EXPRESSLY DISCLAIMS ALL WARRANTIES, INCLUDING BUT NOT LIMITED TO:

• Warranties of merchantability, fitness for a particular purpose, and non-infringement
• Warranties that BeLLMark will meet your specific requirements or produce specific results
• Warranties that BeLLMark will be uninterrupted, error-free, secure, or free of bugs or defects
• Warranties regarding the accuracy or reliability of benchmark results, statistical outputs, or model comparisons
• Warranties that defects will be corrected

LLM-as-judge evaluations and statistical analyses produced by BeLLMark are tools to assist human decision-making — they are not certifications, guarantees, or professional assessments. You are responsible for independently validating any results before relying on them for consequential decisions.

Nothing in these Terms excludes or limits any statutory warranties or guarantees that cannot be excluded or limited under applicable mandatory consumer protection law.

10 Limitation of Liability

TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT SHALL THE DEVELOPER BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL, PUNITIVE, OR EXEMPLARY DAMAGES, INCLUDING BUT NOT LIMITED TO LOSS OF PROFITS, LOSS OF DATA, LOSS OF BUSINESS OPPORTUNITY, OR COST OF SUBSTITUTE GOODS OR SERVICES, ARISING OUT OF OR IN CONNECTION WITH THESE TERMS OR YOUR USE OF BELLMARK, EVEN IF THE DEVELOPER HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

IN ALL CASES, THE DEVELOPER'S TOTAL AGGREGATE LIABILITY TO YOU FOR ANY CLAIMS ARISING UNDER OR IN CONNECTION WITH THESE TERMS OR YOUR USE OF BELLMARK SHALL NOT EXCEED THE TOTAL AMOUNT YOU PAID FOR YOUR BELLMARK LICENSE IN THE TWELVE (12) MONTHS PRECEDING THE CLAIM. IF YOU HAVE NOT MADE ANY PAYMENT (I.E., YOU ARE USING BELLMARK UNDER THE FREE NON-COMMERCIAL LICENSE), THE DEVELOPER'S MAXIMUM LIABILITY SHALL BE €10.

Some jurisdictions do not allow the exclusion or limitation of liability for certain types of damages. In such jurisdictions, our liability is limited to the greatest extent permitted by law. Nothing in these Terms limits our liability for death or personal injury caused by our negligence, fraud or fraudulent misrepresentation, or any other liability that cannot be lawfully excluded.

11 Termination

11.1 Termination for Material Breach

A commercial license may be terminated by the Developer in the event of a material breach of these Terms by the Licensee. Material breaches include, without limitation:

• Redistributing, sublicensing, or reselling BeLLMark or access to BeLLMark in violation of Section 3.4
• Using BeLLMark under a commercial license purchased under false pretenses or through fraudulent means
• Sharing or transferring a commercial license to a legal entity other than the licensed entity
• Using BeLLMark to violate applicable law

11.2 Notice and Cure

Before terminating your license, we will provide written notice (by email to your registered address) describing the alleged breach and giving you 30 days to cure the breach. If the breach is capable of being cured and you cure it within that period, your license shall remain in effect. If the breach is incapable of being cured (e.g., unauthorized redistribution to third parties has already occurred), we reserve the right to terminate without a cure period.

11.3 Effect of Termination

Upon termination of your commercial license, you must immediately cease all commercial use of BeLLMark and delete all copies of the Software deployed under the commercial license. Termination does not entitle you to a refund unless the termination occurs within the 30-day refund window of Section 5 and is at your request.

11.4 Survival

Sections 7 (Intellectual Property), 9 (Disclaimer of Warranties), 10 (Limitation of Liability), 11.4 (Survival), 12 (Governing Law), and 15 (Contact Information) shall survive termination of these Terms.

11.5 Your Right to Terminate

You may terminate your license at any time by ceasing all use of BeLLMark. If you are within the 30-day refund window, you may also request a refund per Section 5. Termination at your initiative does not create any obligation on our part unless a valid refund request accompanies it.

12 Governing Law

These Terms are governed by and construed in accordance with the laws of the Republic of Poland, without regard to its conflict of law provisions. The United Nations Convention on Contracts for the International Sale of Goods (CISG) does not apply to these Terms.

Any disputes arising out of or in connection with these Terms that cannot be resolved by mutual agreement shall be subject to the exclusive jurisdiction of the competent courts in Poland.

Notwithstanding the foregoing, if you are a consumer resident in the European Union, you retain the benefit of any mandatory consumer protection provisions that apply under the law of your country of residence, and you may bring proceedings in the courts of your member state of residence. EU Online Dispute Resolution: consumers in the EU may use the European Commission's Online Dispute Resolution (ODR) platform, available at ec.europa.eu/consumers/odr.

13 EU Consumer Rights

13.1 Right of Withdrawal (14-Day Cooling-Off Period)

Under the EU Consumer Rights Directive (2011/83/EU) and applicable national implementing legislation, consumers in the European Union generally have a 14-day right of withdrawal from contracts for digital content, calculated from the date the contract is concluded.

However, Article 16(m) of the Directive provides that the right of withdrawal does not apply to digital content that is not supplied on a tangible medium, where:

• Performance of the contract has begun with the consumer's prior express consent; and
• The consumer has acknowledged that they will thereby lose their right of withdrawal

13.2 Waiver of Withdrawal Right Upon Delivery

By completing a purchase of a BeLLMark commercial license, you expressly:

• Request immediate delivery of the digital content (your license key/certificate and access to the Software)
• Consent to the performance of the digital content supply beginning immediately upon purchase
• Acknowledge that by giving this consent, you lose your 14-day statutory right of withdrawal once delivery has occurred

13.3 Legal Guarantee of Conformity

Nothing in these Terms affects your statutory rights under EU law regarding the conformity of digital content, including any rights under Directive 2019/770/EU on contracts for the supply of digital content and digital services, as implemented in your member state. If BeLLMark does not conform to the contract (e.g., contains significant defects), you may be entitled to remedies under applicable law in addition to our voluntary refund policy.

13.4 Polish Consumer Law

Consumers in Poland are additionally protected by the Consumer Rights Act of 30 May 2014 (Ustawa o prawach konsumenta) and the Civil Code provisions on consumer contracts. These Terms do not limit any rights granted to you as a consumer under Polish mandatory law.

14 Changes to These Terms

We reserve the right to modify these Terms at any time. When we make material changes, we will:

• Update the effective date at the top of this page
• Publish a notice in the BeLLMark GitHub repository (github.com/Context-Management/BeLLMark) and/or on bellmark.ai
• Where the change materially affects existing commercial licensees, send notice to the email address associated with your license at least 14 days before the change takes effect

Material changes include: changes to the license scope, refund policy, limitation of liability, or governing law. Non-material changes (such as clarifications, corrections of typographical errors, or additions of new sections that do not reduce your rights) may take effect immediately upon publication.

Your continued use of BeLLMark after the effective date of revised Terms constitutes your acceptance of those Terms. If you do not agree to the revised Terms, you may request a refund (if within the 30-day window) or simply cease use of BeLLMark.

Changes to these Terms do not retroactively alter the terms under which an existing commercial license was purchased. The core license grant (perpetual, per-entity, as described in Section 3.2 and 3.3) is not subject to unilateral modification after purchase.

15 Contact Information

If you have any questions about these Terms, need to request a refund, report a compliance concern, or exercise any of your legal rights, please contact us:

For refund requests, please use the subject line "Refund Request" and include your order number or purchase email. We aim to respond to all inquiries within 2 business days.

For legal notices or formal communications regarding these Terms, please send correspondence to [email protected] with the subject line "Legal Notice."