Full Time
Senior Data Engineer – American Airlines Remote Jobs
Job Description
Job Type: Senior Data Engineer from home
Location: Texas work from home
Company: American Airlines
Responsibilities:
- Administer and support one or more platforms for quality, literacy, stewardship, and marketplace data governance
- Supporting the development of new Data Quality, Observability, and Data Access Management software through research, review, suggestion, purchase, installation, and buildout
- Combining our data platform and data governance products
- Supporting Frameworks for Data Governance and Automation
- Design and execute data governance solutions that give insights to help people make better decisions in close collaboration with source data application teams and product owners.
- Design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, and prod support are just a few of the tasks that need to be completed.
- Both working independently and in a collaborative atmosphere, provide technical leadership.
- Join a DevOps team that fully controls and maintains its Data Governance solution.
- Oversees the creation of coding standards, best practices, and governance, privacy, and security rules.
- Creates multi-functional teams by mentoring others in technical and domain skills
Requirements:
Minimum requirements include education and previous work experience.
- A bachelor’s degree in engineering, technology, information systems (CIS/MIS), computer science, or a closely related technical field, or comparable experience or training
- Designing, creating, and deploying large-scale applications or data engineering solutions over the course of three years while utilizing agile and DevOps.
- 3 years of SQL data analytics experience
- Experience with Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for the past two years, with a preference for Microsoft Azure.
- Experience in a variety of the following tools/platforms, including Development, Administration, and Support, is required:
- Python, Spark, Unix, and SQL scripting
- Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, and Snowflake are examples of data platforms.
- Data Explorer for Azure. administrative expertise is a plus
- Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Azure Functions are examples of Azure Cloud Technologies.
- GitHub, Jenkins, Azure DevOps, Terraform, and CI/CD
- Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana comprise the BI Analytics Tool Stack.
- DataStage and Informatica for Data Warehousing
- Data Governance and Privacy Using BigID, Anomalo, Montecarlo, and Other Data Quality Tools from Informatica
Prior work experience and education are preferred qualifications.
- 5+ years of experience in the design, development, and implementation of large-scale applications or data engineering solutions employing an agile, dev ops, product approach.
- 5+ years of SQL data analytics experience
- 3+ years of experience in full-stack development, ideally in Azure
- Experience with Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for at least three years (prefer Microsoft Azure).
- 3+ years of expertise with data platform and data governance products
- Experience in the airline industry
Knowledge, Permits, and Certifications
- Knowledge of data management, ingestion, capture, processing, curation, and layer creation using the Azure Technology stack.
- Knowledge of giving useful guidance within Azure Native cloud services.
- Certification for the Azure Development Track (recommended)
