Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UI Ingestion task was never scheduled #12468

Open
lu-xiaoshuang opened this issue Jan 27, 2025 · 0 comments
Open

UI Ingestion task was never scheduled #12468

lu-xiaoshuang opened this issue Jan 27, 2025 · 0 comments

Comments

@lu-xiaoshuang
Copy link

lu-xiaoshuang commented Jan 27, 2025

I tried to run an UI Ingestion but the task was never scheduled.

version: 0.15.0
components: metadata-service, frontend
ingestion configuration:

source:
    type: mysql
    config:
        host_port: 'mysql-address:mysql-port'
        database: null
        username: mysql-username
        include_tables: true
        include_views: true
        profiling:
            enabled: true
            profile_table_level_only: true
        stateful_ingestion:
            enabled: true
        password: mysql-password
sink:
    type: datahub-rest
    config:
        server: 'http://metadata-service-address:metadata-service-port'
        token: blah-blah-blah

Image

Did I make something wrong?

By the way, docs on UI ingestion are confusing.

  1. Docs Home => Features => Ingestion (https://datahubproject.io/docs/ui-ingestion)
I see 'N/A' when I try to run ingestion. What do I do?
If you see 'N/A', and the ingestion run state never changes to 'Running', this may mean that your executor (datahub-actions) container is down.

This container is responsible for executing requests to run ingestion when they come in, either on demand on a particular schedule. You can verify the health of the container using docker ps. Moreover, you can inspect the container logs using by finding the containoCodeer id for the datahub-actions container and running docker logs <container-id>.
  1. Docs Home => Deployment => Deployment Guides => Deploying with Docker (https://datahubproject.io/docs/docker)
[acryldata/datahub-actions](https://hub.docker.com/r/acryldata/datahub-actions). Do not use acryldata/acryl-datahub-actions as that is deprecated and no longer used.
  1. Source Code Root Directory/docker/datahub-actions (https://github.com/datahub-project/datahub/tree/master/docker/datahub-actions)
./README.md
./env/docker.env

This directory is almost empty. There are even no docker files.

@lu-xiaoshuang lu-xiaoshuang changed the title UI Ingestion but the task was never scheduled UI Ingestion task was never scheduled Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant