Discussions

• 1 You must be logged in to vote

  📣

  Pacific AI Releases LangTest 2.7.0: AMEGA Clinical Guideline Benchmark, MedFuzz Robustness Testing, Randomized QA Options, Expanded Clinical Summarization Support, MentalChat16K Integration, and Enhanced Security

  chakravarthik27 announced Sep 22, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Unable to initialize harness with CSV file for text classification task

  StellaRK99 asked Apr 29, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  📣

  John Snow Labs Releases LangTest 2.6.0: De-biasing Data Augmentation, Structured Output Evaluation, Med Halt Confidence Tests, Expanded QA & Summarization Support, and Enhanced Security

  chakravarthik27 announced Mar 11, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Basic Setup within Datrabricks using azure-openai

  🐛 Bug Something isn't working

  GrahamJWills asked Sep 11, 2024 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  📣

  John Snow Labs Releases LangTest 2.5.0: Spark & Delta Live Tables Support, Image & Performance Robustness Tests, Customizable LLM Templates, Enhanced VQA & Chat Models

  chakravarthik27 announced Dec 24, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  John Snow Labs Releases LangTest 2.4.0: Introducing Multimodal VQA Testing, New Text Robustness Tests, Enhanced Multi-Label Classification, Safety Evaluation, and NER Accuracy Fixes

  chakravarthik27 announced Sep 23, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  John Snow Labs releases LangTest 2.3.1: Critical Bug Fixes and Enhancements

  chakravarthik27 announced Sep 12, 2024 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  John Snow Labs releases LangTest 2.3.0: Enhancing LLM Evaluation with Multi-Model, Multi-Dataset Support, Drug Name Swapping Tests, Prometheus Integration, Safety Testing, and Improved Logging

  chakravarthik27 announced Jul 16, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs releases LangTest 2.2.0: Advancing Language Model Testing with Model Comparison and Benchmarking, Few-Shot Evaluation, NER Evaluation for LLMs, Enhanced Data Augmentation, and Customized Multi-Dataset Prompts

  chakravarthik27 announced May 15, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 2.0.0: Comprehensive Model Benchmarking, Added support for LM Studio , CLI Integration for Embedding Benchmarks, Enhanced Toxicity Tests, Multi-Dataset Comparison and elevated user experience with various bug fixes and enhancements.

  ArshaanNazir announced Feb 21, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Issues setting up

  lpalomares asked Jan 30, 2024 in Q&A · Answered

  

  

  6
• 2 You must be logged in to vote

  💬

  I am curious if the evaluation results of Langtest only have a pass rate?

  VelikayaScarlet started Jan 26, 2024 in General

  

  

  1
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.10.0: Support for Evaluating RAG with LlamaIndex and Langtest, Grammar Testing, Robust Checkpoint Managememt, and Comprehensive Support for Medical Datasets (LiveQA, MedicationQA, HealthSearchQA), Direct Hugging Face Model Integration and Elevated User Experience with Numerous Bug Fixes !

  ArshaanNazir announced Dec 23, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.9.0: Hugging Face Callback Integration, Advanced Templatic Augmentation, Comprehensive Model Benchmarking, Expanded Clinical Dataset Support (MedQA, PubMedQA, MedMCQ), Insightful Blogposts, and Enhanced User Experience with Key Bug Fixes

  ArshaanNazir announced Dec 1, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.8.0: Codebase Refactoring, Enhanced Debugging with Error Codes, Streamlined Categorization of Tasks, Various Blogposts, Improved Open Source Community Standards and Enhanced User Experience through Multiple Bug Fixes !

  ArshaanNazir announced Nov 10, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.7.0: Broadening Question-Answering Evaluation, Custom Model APIs, StereoSet Integration, FiQA Dataset, New BlogPosts, Gender Occupational Bias Assessment in LLMs and Enhanced User Experience through Multiple Bug Fixes !

  ArshaanNazir announced Oct 24, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Custom model API endpoint support

  WiktorSobanski asked Sep 13, 2023 in Q&A · Answered

  

  

  3
• 3 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.6.0: Broadening Benchmark Horizons with CommonSenseQA, PIQA, SIQA Datasets, Unveiling Toxicity Sensitivity Test, Legal-QA Evaluations Enriched with Consumer Contracts, Privacy-Policy, Contracts-QA Datasets, Challenging Biases with Sycophancy and Crows-Pairs Stereotype Tests, and Enhanced User Experience through Multiple Bug Fixes.

  ArshaanNazir announced Oct 3, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.5.0: Gender Stereotype Analysis with Wino-Bias, Enhancement with Legal-Support, Legal-Summarization (Multi-LexSum Dataset), Factuality & Negation-Sensitivity Tests, Updated Gender Classifier, and Streamlined Bug Resolutions for Better User Experience.

  ArshaanNazir announced Sep 19, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.4.0 : Unveiling Political Compass & Disinformation Tests for LLMs, Inclusion of Novel Datasets (LogiQA, asdiv, Bigbench), Enhanced QA & Summarization for HF Models, Refined Codebase, Amplified Test Evaluations, and Comprehensive Bug Fixes for Optimal User Experience.

  ArshaanNazir announced Sep 4, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.3.0: Clinical Test Support, Model & Dataset Uploading to HF, Prompt-Injection Exploration, Codebase Refinement, Enhanced Unit Test Coverage and Support for custom column names for CSV loading.

  ArshaanNazir announced Aug 18, 2023 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.2.0: Enhancing Support for HF Dataset Augmentations, Advanced HF NER Support, Seamless End-to-End NER-HF Pipelines, Support for MLflow Metric Tracking and Performance Benchmarking with Speed Tests.

  ArshaanNazir announced Aug 3, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests.

  ArshaanNazir announced Jul 18, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs - LangTest 1.0.0: An open-source library for delivering safe & effective models into production!

  ArshaanNazir announced Jul 3, 2023 in Announcements

  

  

  0
• 4 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.5.0: Amplifying Model Comparisons, Bias Tests, Runtime Checks, Harnessing HF Datasets for Superior Text Classification and Introducing Augmentation Proportion Control

  ArshaanNazir announced Jun 16, 2023 in Announcements

  

  

  0