How to download file from private repository using API token

[tomas_lopez]

So far I got this

async def download_raw_file_from_bitbucket(url: str) -> Optional[Any]:

    parsed = _parse_bitbucket_url(url)

    if not BITBUCKET_EMAIL or not BITBUCKET_API_TOKEN:
        raise Exception("Missing Bitbucket email or API token")

    api_url = (
        f"https://api.bitbucket.org/2.0/repositories/"
        f"{parsed['workspace']}/{parsed['repo_slug']}/src/"
        f"{parsed['commit']}/{parsed['path']}"
    )

    async with aiohttp.ClientSession() as session:
        async with session.get(
                api_url,
                auth=aiohttp.BasicAuth(BITBUCKET_EMAIL, BITBUCKET_API_TOKEN),
                allow_redirects=True,
        ) as response:
            if not response.ok:
                raise Exception(f"{response.status} {await response.text()}")
            text = await response.text()
            try:
                return json.loads(text)
            except json.JSONDecodeError:
                return text

But no matter what I try, the response is always "Token is invalid, expired, or not supported for this endpoint.". I know the token is valid, it's freshly generated and has access to everything.

The URL look like this: 

https://bitbucket.org/<username>/<repo>/<folder>/<folder>/<folder>/<folder>/file.extension

[Syahrul]

Hey @tomas_lopez 

Welcome to the community!

From my observation, I believe your path is incorrect, which is why you receive an error indicating the token is invalid. Please try using this curl example with the API token and your path to see if you can download the files.

Example:

curl --request GET \
  --url 'https://api.bitbucket.org/2.0/repositories/<Workspace>/<Repo>/src/<Branch>/<folder>/file.txt' \
  --header 'Authorization: Bearer <access_token>' \
  --header 'Accept: application/json'

Workspace: Your workspace name
Repo: Your repository name
Branch: Your branch where the file located
Path: Your file path

The path you use doesn't include branch which is why it's failing. I suggest try above example to verify before applying it on your script

Regards
Syahrul

[tomas_lopez]

Hey! Thanks for the help. After your comment, I changed my code to this:

def _parse_bitbucket_url(value: str) -> Dict[str, str]:

    parsed_url = urlparse(value)
    if not parsed_url.scheme or "bitbucket.org" not in parsed_url.netloc:
        raise Exception("Only links to bitbucket.org are supported")

    url_path = Path(parsed_url.path)
    parts = url_path.parts
    if len(parts) < 6 or parts[3] != "src":
        raise Exception("Unsupported Bitbucket URL structure")

    workspace = parts[1]
    repo_slug = parts[2]
    commit = parts[4]
    file_path = "/".join(parts[5:])

    return {
        "workspace": workspace,
        "repo_slug": repo_slug,
        "branch": commit,
        "path": file_path
    }


async def download_raw_file_from_bitbucket(config: RunConfigurator, url: str) -> Optional[Any]:
    BITBUCKET_API_TOKEN = KeyManager(getattr(config, 'api_keys', {})).get_key("BITBUCKET_API_TOKEN")

    parsed = _parse_bitbucket_url(url)

    api_url = (
        f"https://api.bitbucket.org/2.0/repositories/"
        f"{parsed['workspace']}/{parsed['repo_slug']}/src/"
        f"{parsed['branch']}/{parsed['path']}"
    )

    headers = {
        "Authorization": f"Bearer {BITBUCKET_API_TOKEN}",
        "Accept": "application/json"
    }

    async with aiohttp.ClientSession() as session:
        async with session.get(api_url, headers=headers, allow_redirects=True) as response:
            if not response.ok:
                raise Exception(f"{response.status} {await response.text()}")

            text = await response.text()
            try:
                return json.loads(text)
            except json.JSONDecodeError:
                return text

But I still got the same "Token is invalid, expired, or not supported for this endpoint." error.

I tried with this cURL request:

curl -H "Authorization: Bearer <my token goes here>" -H "Accept: application/json" "https://api.bitbucket.org/2.0/repositories/<user>/<repo>/<folder>/<folder>/<folder>/<folder>/<file.extension>"

But I still got the same "Token is invalid, expired, or not supported for this endpoint." error.

[Syahrul]

Hi @tomas_lopez 

Understood. Could you tell me which access token you used? I tested with a repository access token that has read-only permissions and managed to download the files using the curl command I shared, without any problems. Please try that approach and let me know how it goes.

Thanks!
Syahrul 

[Artur Sadurski]

Hey there!
I'm working on it with @tomas_lopez
I'll just answer on his behalf.

IT support told us: "The token is for a generic Atlassian account we have, 'user@company.com'. It has normal member permissions, so it doesnt have Admin permissions. There's only one way to create an API token within Atlassian as far as I am aware. Everyone can create one from their own account, but it's best to use a generic account in case of leavers etc. "

What other info can I get for you?  Thanks for your answers so far!

[tomas_lopez]

@Syahrul sorry to bother, is there any update on this? I've corroborated with my IT-support department that the account linked to the API token has admin access to the repository where the file is hosted but Im still getting "Token is invalid, expired, or not supported for this endpoint."

Just to be sure, this is the request Im making, can you corroborate if it's correctly formatted:

curl --request GET --url 'https://api.bitbucket.org/2.0/repositories/<org>/<repo>/<folder>/<folder>/<folder>/<folder>/<file>' --header 'Authorization: Bearer MY_TOKEN_GOES_HERE' --header 'Accept: application/octet-stream'

[Syahrul]

Hi team,

Sorry for missing this. Could you please raise a support ticket on our Support portal so we can investigate the issue further? I believe this will be quicker since you have a paid workspace, allowing us to resolve it promptly.

Regards,
Syahrul

[tomas_lopez]

Thanks! Support request has just been submitted