Skip to main content
​
1.2.8
2025-10-01

​
v1.2.8

​
Fixes and Improvements

  • Fixed redundant failed batch status update for batch jobs.
  • Fixed - Retry failed job status check and update status accordingly.
​
1.2.7
2025-08-16

​
v1.2.7

​
Fixes and Improvements

  • Fixed encoding issues for file uploads to S3.
​
1.2.6
2025-07-22

​
v1.2.6

​
Features

  • Azure Redis support for cache with auth modes including Entra and Managed Identity.
  • HTTPS Proxy support for all the external calls & HTTPs communication between PODs.
  • Added support for virtual key inclusion for custom log if passed in headers.
  • Entra and Managed Identity support for Azure Log Store.

​
Fixes and Improvements

  • Support Batch output from gateway directly.
​
1.2.5
2025-06-28

​
v1.2.5

​
Fixes and Improvements

  • Update dependencies for better performance for file uploads/downloads.
​
1.2.4
2025-06-17

​
v1.2.4

​
Fixes and Improvements

  • Fixed issue with custom batches missing cost calculation for some provider models
​
1.2.3
2025-06-17

​
v1.2.3

​
Fine-tuning and Batch Processing

  • Added support for configurable FINETUNE_STATUS_CHECK_INTERVAL for provider fine-tuning status check operations.
  • Added support for configurable BATCH_STATUS_CHECK_INTERVAL for provider batch processing status check operations.
  • Both values should be in milliseconds. Minimum value is 10000 milliseconds.
  • If not provided, will default to 10 seconds.
​
1.2.2
2025-05-31

​
v1.2.2

​
Observability

  • Added support for below Prometheus Counters
    • batch_count
    • batch_cost
    • batch_input_tokens
    • batch_total_tokens
    • batch_process_time
    • batch_success_row_count
    • batch_failure_row_count
    • batch_row_count
  • With the below labels
    • provider
    • type (provider/custom)

​
Fixes and Improvements

  • Fixed issue with attributing incorrect created at time stamp for batch processing
  • Including error source as control plane for control plane failures
​
1.2.1
2025-05-21

​
v1.2.1

​
Data exports

​
Fixes and Improvements

  • Fixed issue with custom batches for small batch files
​
1.2.0
2025-05-17

​
v1.2.0

​
Custom S3 Support

  • Added support for s3_custom log store option for batches and fine-tunes.

​
Fixes and Improvements

  • Fixed issue with STS token generation for AWS.
​
1.1.12
2025-05-09

​
v1.1.12

​
Fixes and Improvements

  • Fixed issue with cost calculation for custom batches.
​
1.1.11
2025-05-03

​
v1.1.11

​
Fixes and Improvements

  • Fixed issue where queue remains stuck in a queued state during file validation.
​
1.1.10
2025-04-21

​
v1.1.10

​
S3 Upload Improvements

  • Added support for passing encryption headers while uploading stream data to S3.
  • Added support for both file path and direct value from environment variables for secrets like redis connection.

​
Stream Handling

  • Improved stream cleanup for validation processes.
​
1.1.9
2025-04-10

​
v1.1.9

​
File Handling Fixes

  • Fixed issue with extra bytes being added to files during processing.
​
1.1.8
2025-04-04

​
v1.1.8

​
File Upload Improvements

  • Updated socket timeout for long requests during file uploads to prevent timeouts.
​
1.1.7
2025-03-28

​
v1.1.7

​
Fireworks Fine-tuning Support

  • Added support for Fireworks fine-tuning operations using Version2.

​
Batch Processing Improvements

  • Included response tokens calculation in provider batch output.
  • Fixed file loading in memory issues for better performance.
​
1.1.6
2025-03-25

​
v1.1.6

​
S3 SDK Updates

  • Upgraded S3 SDK to latest version for fixing issue with S3 streaming.
​
1.1.5
2025-03-21

​
v1.1.5

​
Batch Processing Enhancements

  • Improved provider batch output handling.
  • Added support for custom batch output paths.
  • Increased maximum lines for custom batches to 500k and chunk size to 5MB for better performance.
​
1.1.4
2025-03-20

​
v1.1.4

​
Vertex Embeddings Batches Support

  • Added support for Vertex batch embeddings.

​
Batch Processing Updates

  • Included model information in log objects.
  • Implemented custom batch processing output generations.

​
Internal POD to POD HTTPS Support

  • Added support for internal POD to POD HTTPS communication.
  • This can be enabled by mounting a volume with certificate and key.
  • TLS_KEY_PATH and TLS_CERT_PATH environment variables will be used to fetch the certificate and key from the volume.
​
1.1.3
2025-03-07

​
v1.1.3

​
Infrastructure Updates

  • Streamlined uploaded file location for Bedrock operations.
​
1.1.2
2025-02-27

​
v1.1.2

​
Vertex Integration

  • Added support for Vertex provider options for batches.

​
Infrastructure Updates

  • Implemented cluster mode Redis for queues.
  • Updated fine-tune status handling.
​
1.1.1
2025-02-20

​
v1.1.1

​
S3 Enhancements

  • Made S3 bucket optional for Bedrock batches.
  • Added S3 encryption header support for finetunes and batches.
  • Implemented SSE file upload support.

​
Logging Improvements

  • Added filtering for log exports.
  • Implemented end limit for log export records.

​
Performance Optimizations

  • Implemented internal memory cache for better performance.
​
1.1.0
2025-02-10

​
v1.1.0

​
Bull Board Integration

  • Added Bull Board for visualizing job queues and their status.

​
Batch Job Retry Support

  • Implemented retry functionality for batch jobs to handle failures gracefully.

​
Prometheus Metrics Enhancements

  • Added Prometheus metrics for batch jobs and fine-tuning operations.
​
1.0.8
2025-02-04

​
v1.0.8

​
Azure Fine-tuning Support

  • Added support for Azure OpeAI fine-tuning operations.
​
1.0.7
2025-01-13

​
v1.0.7

​
Fine-tune v2

  • Implemented version 2 of the fine-tuning functionality.
​
1.0.6
2024-01-08

​
v1.0.6

​
Prompt Slug Filter

  • Added support for data exports filtering by PromptSlug.
​
1.0.5
2024-01-06

​
v1.0.5

​
Batch Processing

  • Added provider and custom [Batch] (/product/ai-gateway/batches) processing functionality.
​
1.0.4
2023-12-17

​
v1.0.4

​
Code Quality Improvements

  • Fixed dynamic port retrieval from environment variables.
​
1.0.3
2023-11-28

​
v1.0.3

​
Vision Fine-tuning Support

  • Added support for vision fine-tuning validation for OpenAI.
  • Implemented S3 bucket support for fine-tunes.

​
AWS Integration Improvements

  • Fixed assumed role handling for Bedrock fine-tuning dataset URLs.
  • Improved S3 bucket path handling for Bedrock fine-tune operations.
  • Achieved parity with Enterprise Gateway for data sources.
​
1.0.2
2023-11-20

​
v1.0.2

​
Fine-tuning Enhancements

  • Added support for OpenAI job start and Fireworks upload.
  • Improved handling of chunk type failures with JSON.
​
1.0.1
2023-10-25

​
v1.0.1

​
Fireworks Fine-tuning Support

  • Added support for Fireworks fine-tuning operations.
​
1.0.0
2023-10-04

​
v1.0.0

​
Initial Release

  • Base version of the Data Service with core functionality.