DNEXT
Sousse
AI Data Mapper (Intern)
Data Engineering et Machine Learningdata analysismachine learning
Publié il y a 5 mois
Stage
⏱️4-6 mois
💼Hybride
📅Expiré il y a 4 mois
Mets un projet récent en avant.
Description du poste
- Project Description:
- Develop an intelligent system to suggest accurate mappings between client-specific schemas and a master mapping.
- Minimize manual work while ensuring high data quality and client customization.
- Responsibilities:
- Build algorithms to identify and suggest accurate mappings between different data schemas.
- Automate data flow orchestration for accurate mapping of client-specific schemas to the master schema.
- Refine the system to enhance the accuracy and efficiency of data mappings over time.
- Create an intuitive interface using Streamlit for users to view and interact with suggested mappings.
- Technologies:
- Python & Dagster: Utilized for data processing, building mapping algorithms, and automating workflows with libraries like pandas, numpy, and scikit-learn.
- SQL: Used for managing and querying databases storing schema and mapping data.
- Power BI & Streamlit: Employed for creating interactive dashboards and visualizations to display mapping results and system performance.