Understanding and Troubleshooting Custom Transformer Behavior in DataHub

ingestion
1

Original Slack Thread

<@U06TM7M40RK> I have created a custom transformer. On using the transformer in a recipe transformer gets called when database_pattern is defined, otherwise the transformer is not used. why would that be ?

2

I’m not able to find any data sources to answer your question. You might want to provide more details about the specific configuration of your custom transformer and how it interacts with the database_pattern. If this doesn’t help, please reach out to the DataHub support team for further assistance. :+1: 0 button :-1: 0 button :bulb: Hint: Mention @runllm in the thread for followups.

3

setup.py looks like this


setup(
    name="domain_from_hier_slug",
    version="1.0",
    packages=find_packages(),
    # if you don't already have DataHub Actions installed, add it under install_requires
    # install_requires=["acryl-datahub-actions"]
    entry_points={
        "datahub.ingestion.transformer.plugins": [
            "get_domain_from_hier_domainslug = domain_from_hier_slug:AddDomainFromHierarchy",
        ],
    },
)```
4

datahub version: v0.14.0.2

5

<@U06TM7M40RK> The transformer is an extension of (BaseTransformer, SingleAspectTransformer) classes.
Here’s how the setup.py looks like


setup(
    name="domain_from_hier_slug",
    version="1.0",
    packages=find_packages(),
    # if you don't already have DataHub Actions installed, add it under install_requires
    # install_requires=["acryl-datahub-actions"]
    entry_points={
        "datahub.ingestion.transformer.plugins": [
            "get_domain_from_hier_domainslug = domain_from_hier_slug:AddDomainFromHierarchy",
        ],
    },
)```