# Panjaya Dubbing Studio API ## Authentication To authenticate with the API, you will need to provide your API key in the Authorization header of each request. It should look like this: ```http Authorization: Bearer panjaya-{YOUR_API_KEY} ``` ## Languages support Below is a list of supported languages and their corresponding locale codes that are used in Panjaya Dubbing Studio API. Please note that some languages are marked as source languages only, meaning they can only be used as the source language of the uploaded videos, while some are marked as target languages only - meaning they can only be translated into. | Language | Locale code | Source supported | Target supported | |--------------------|-------------|------------------|------------------| | Arabic | ar-AE | ✅ | ✅ | | Bulgarian | bg-BG | ✅ | ✅ | | Chinese | zh-CN | ✅ | ✅ | | Croatian | hr-HR | ✅ | ✅ | | Czech | cs-CZ | ✅ | ✅ | | Danish | da-DK | ✅ | ✅ | | Dutch | nl-NL | ✅ | ✅ | | English | en-US | ✅ | ✅ | | Filipino | fil-PH | ✅ | ✅ | | Finnish | fi-FI | ✅ | ✅ | | French | fr-FR | ✅ | ✅ | | German | de-DE | ✅ | ✅ | | Greek | el-GR | ✅ | ✅ | | Hebrew | he-IL | ✅ | 🚫 | | Hindi | hi-IN | ✅ | ✅ | | Hungarian | hu-HU | ✅ | ✅ | | Indonesian | id-ID | ✅ | ✅ | | Italian | it-IT | ✅ | ✅ | | Japanese | ja-JP | ✅ | ✅ | | Korean | ko-KR | ✅ | ✅ | | Lithuanian | lt-LT | ✅ | ✅ | | Malay | ms-MY | ✅ | ✅ | | Norwegian | nb-NO | ✅ | ✅ | | Polish | pl-PL | ✅ | ✅ | | Portuguese | pt-BR | ✅ | ✅ | | Portuguese | pt-PT | ✅ | ✅ | | Romanian | ro-RO | ✅ | ✅ | | Russian | ru-RU | ✅ | ✅ | | Slovak | sk-SK | ✅ | ✅ | | Spanish | es-ES | ✅ | ✅ | | Spanish | es-MX | ✅ | ✅ | | Swedish | sv-SE | ✅ | ✅ | | Tamil | ta-IN | ✅ | ✅ | | Turkish | tr-TR | ✅ | ✅ | | Ukrainian | uk-UA | ✅ | ✅ | | Vietnamese | vi-VN | ✅ | ✅ | ## Error codes Panjaya Dubbing Studio API uses standard HTTP status codes to indicate the success or failure of an API request. In case of an error, the response body will include a detailed error message to help you identify and resolve the issue. Here is a list of erroneous HTTP status codes and their general meanings: - **401 Unauthorized**: The API key could not be validated - **400 Bad Request**: The request could not be processed due to invalid input - **403 Forbidden**: The request could not be completed due to account limitations - **404 Not Found**: The requested resource was not found - **500 Internal Server Error**: An internal server error occurred ## Servers ``` https://api.panjaya.ai ``` ## Security ### api_key To access this endpoint, provide your Panjaya API key in the `Authorization` HTTP header when making requests. Use the bearer format as shown below. Type: http Scheme: bearer ## Download OpenAPI description [Panjaya Dubbing Studio API](https://docs.panjaya.ai/_spec/apis/index.yaml) ## Assets Assets are the core resource in Panjaya Dubbing Studio. An asset represents a source video you want to dub into different languages. Each asset can be dubbed into multiple languages, and every language is assigned a unique dubbing ID. You can optionally add SRT files for better accuracy. ### Creating a new asset - [POST /v1/assets/](https://docs.panjaya.ai/apis/assets/assets-create_asset.md): Creating an asset is the first step to dubbing your video with Panjaya Dubbing Studio. This endpoint allows you to: - Upload a source video - Configure the necessary parameters to initiate the dubbing process ### Uploading the Source Video - Use the parameter to specify the publicly accessible URL of the source video you want to dub. - Set the field to indicate the original language of the source video. - It is recommended to set the field to the number of distinct speakers in the video, to improve accuracy and quality of the final video. ### Adding Target Languages Define the languages into which you want to dub the video: Panjaya's locale codes adhere to the IETF Language Tag standard, combining ISO 639-1 language codes and ISO 3166-1 country codes. Examples: (English - United States), (Spanish - Spain), (Chinese - China). For each target language, you may optionally provide a valid SRT file, where applicable, in the designated field. ### Trimming the Video You can optionally use the and parameters to trim your video, allowing you to dub a specific section of your video. Both parameters accept a number of seconds from the beginning of the video. For example, if you want to dub only the first 2 minutes of your video, set to . If not specified, defaults to (beginning of the video), and defaults to the end of the video. ### Status Updates via Callbacks Optionally, you can configure a to receive real-time status updates about the dubbing process. When a is specified, Panjaya will send updates whenever the status of an asset or any of its dubbing versions changes. For detailed information on implementing callbacks, refer to the Callbacks section of this documentation. ### Models The field specifies which lips model to use when generating versions under this asset. This parameter is only applicable when lip correction is enabled. You can use it to fine-tune the balance between quality and performance. * (Default): Our highest-quality lips model, suitable for most use cases. * : Optimized for speed - up to 4× faster than , while maintaining high quality. ### Background Audio Panjaya uses our SceneAware audio separation model to separate speech from background audio in the source video. This preserves the original background audio in the dubbed result, creating a more natural and immersive experience. If you already have a clean background audio track (e.g., music and sound effects without speech), you can provide a publicly accessible URL to it via the field. Panjaya will then use this track directly instead of separating background audio from the source video. ### Uploading a new asset - [POST /v1/assets/upload](https://docs.panjaya.ai/apis/assets/assets-upload_asset.md): Upload an asset video file directly to Panjaya Dubbing Studio. This endpoint allows you to upload a video file directly, saving the need to upload to an external storage service. It accepts the same parameters as the Create Asset endpoint, except for the parameter, which is replaced by the file input. Note that this endpoint is structured as a request, where the form field contains a JSON-serialized object with the asset parameters, and the form field contains the video file to be uploaded. You may additionally provide a file to upload a clean background audio track. Refer to Background Audio section under create asset endpoint. ### Get an asset - [GET /v1/assets/{asset_id}](https://docs.panjaya.ai/apis/assets/assets-get_asset.md): After creating an asset - either through the Panjaya Dubbing Studio API or by uploading it via the Panjaya Dubbing Studio web interface - you can easily fetch detailed information about the asset by specifying its asset ID. This endpoint allows you to access key metadata, including the asset's current status, associated dubbings, and available versions. ### Asset processing failures In case of an error while processing the asset, the asset status will be , and the field in this endpoint's response will contain helpful information for identifying the issue. It contains an error code and a detailed error message to help you understand and resolve the issue. Here is a list of common error codes for assets: - : The input provided is invalid. Ensure all provided fields match the asset's properties. - : We didnt find a valid video stream in the media file. - : No spoken content was identified in the uploaded video. - : No audio tracks were found in the source video. - : The video duration limit for your account has been reached. - : The file size of the requested video has exceeded the allowed size limit. - : The provided start_time or end_time is out of video range. Ensure that the timestamps are within the video duration. ### Add languages to an existing asset - [POST /v1/assets/{asset_id}/languages](https://docs.panjaya.ai/apis/assets/assets-add_languages.md): With this endpoint, you can add new languages to an existing asset. Once you make the request, Panjaya will initiate a new dubbing process for each added language. Once the process is complete, you will be notified via email and the callback URL, if configured. ## Versions After upload, an initial version of the dub is automatically created for each language. You can create additional versions for each language to act as snapshots in time as you edit or to edit independently, with each version identified by a unique version ID. ### Get a dubbing version - [GET /v1/versions/{version_id}](https://docs.panjaya.ai/apis/versions/versions-get_version.md): Retrieve detailed information about a specific dubbing version by providing its unique Version ID. #### Response Details The response includes metadata about the version, such as its current status and progress in the dubbing process. The field provides a link to , where you can fine-tune the dubs further. This URL is not signed and requires authentication. Use the endpoint (as described below) to pre-sign a URL. If the final video has been successfully generated, the response will also include a signed URL in the field. This URL allows you to securely download the fully synchronized video, complete with lip and body language alignment. #### Version Status The field indicates the current state of the version. Possible values include: - : The version is currently being prepared for editing. - : The version is ready for editing and refinement in the Panjaya Dubbing Studio web interface. - : The version is being processed to generate the final video. Editing is temporarily disabled during this stage. - : The version has been successfully generated and is ready for download. - : An error occurred during the version processing. ### Revise version - [PATCH /v1/versions/{version_id}/revise](https://docs.panjaya.ai/apis/versions/versions-revise_version.md): Revert a generated dubbing version to editing mode in the Panjaya Dubbing Studio. Once a dubbing version is successfully generated, its status changes to , allowing only preview access to the generated video. If further edits are needed, use this endpoint to restore the version to an . : This action permanently removes the generated video and its associated . If provided this endpoint will return a URL to the Panjaya Dubbing Studio. See the Create a signed URL endpoint for more details. #### Version Status This operation is only allowed if the version status is either , or . Upon execution, the version status will be updated to , allowing further modifications. ### Generate version - [POST /v1/versions/{version_id}/generate](https://docs.panjaya.ai/apis/versions/versions-generate_version.md): Initiate the generation process for a dubbing version. Once the process is complete, and you'll receive notifications via or a , if configured (see below). Your final video will then be available for download. #### Version Status This operation is only allowed if the version status is . Upon execution, the version status will be updated to , until the generation process is completed, after which the version status will be updated to . ### Create a signed URL for version - [POST /v1/versions/{version_id}/studio_url](https://docs.panjaya.ai/apis/versions/versions-get_studio_url_for_version.md): Create a URL that allows anyone with the link to access the Panjaya Dubbing Studio for a specific dubbing version. This endpoint is useful for sharing a version with collaborators or reviewers who need to make edits or QC the dubbing, without requiring them to log in. The generated URL provides a pre-signed access to the Panjaya Dubbing Studio, where users can view the dubbing version, adjust the text, and fine-tune the dubbing. The access is limited to the specific version and does not allow access to other versions or assets. Adjust the parameter to specify the duration in minutes for which the URL will remain valid. The default expiration time is 3 hours. ### Get a version's subtitles - [GET /v1/versions/{version_id}/srt](https://docs.panjaya.ai/apis/versions/versions-get_version_srt.md): Fetch the current version's source transcript or target translation, formatted as an SRT file. Use the query parameter to indicate the desired subtitles - Set to for fetching the transcript in the asset's source language, or for fetching the current translation in the version's target language. ## Callbacks Learn how to use a callback URL to receive real-time status updates about the dubbing process. ### Receiving Status Updates - [POST /callback](https://docs.panjaya.ai/apis/callbacks/callback_callback_post.md): To stay informed about the progress of dubbing processes, you can configure a callback URL. For every status update related to an asset or its versions, Panjaya will send an HTTP request to the specified URL. Each update includes the following details: * : The unique identifier for the asset. This field is always included. * : The unique identifier for the version. This field is optional and is included only for version-related events. * : The target language of the version. This field is optional and is included only for version-related events. * specifies the type of event that occurred. Possible values are: * : An error occurred while processing the asset. In this case, field will be . * : The version is ready for QC and additional editing in the workspace * An error occurred during the dubbing process for this version. * The version final video generation process has started. * : The version has been successfully generated. A URL to download the final video will be provided in the field in Get Version endpoint. * : An error occurred during the video generation process. ### Signature verification To ensure the authenticity of our callback requests, each request will include a signature in the header. The signature is calculated on the raw HTTP request's body, using the ES256 algorithm. Optionally, you may use the header to verify the authenticity of our request in your server. Below is Panjaya's public key, to be used for verifying our callback's content: And here's an example of how to verify the signature in Python: Here's an example of the payload you can expect: