Full Time
Data Engineer – Remote Overnight Jobs
Job Description
Job Type: Data Engineer from home
Location: Texas work from home
Company: American Airlines
Responsibilities:
- Design, build, and support analytics solutions that offer insights to help make smarter decisions in close collaboration with source data application teams and product owners.
- Utilize Azure services and products (such as Azure Data Factory, Azure Data Factory Storage, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) as well as conventional data warehouse technologies to implement data migration and data engineering solutions.
- Design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, and prod support are just a few of the tasks that need to be completed.
- Both working independently and in a collaborative atmosphere, provide technical leadership.
- Join a DevOps team that fully controls and maintains its product.
- Utilize cloud technology to implement batch and streaming data pipelines.
- Oversees the creation of coding standards, best practices, and security and privacy policies.
- Helps people develop their technical and domain expertise to build multifunctional teams.
Requirements:
Minimum requirements include education and previous work experience.
- A bachelor’s degree in engineering, technology, information systems (CIS/MIS), computer science, or a closely related technical field, or comparable experience or training
- Designing, creating, and deploying large-scale applications or data engineering solutions over the course of three years while utilizing agile and DevOps.
- 3 years of SQL data analytics experience
- Experience with Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for the past two years, with a preference for Microsoft Azure.
- Experience in a variety of the following tools/platforms, including Development, Administration, and Support, is required:
- Python, Spark, Unix, and SQL scripting
- Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, and Snowflake are examples of data platforms.
- Data Explorer for Azure. administrative expertise is a plus
- Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Azure Functions are examples of Azure Cloud Technologies.
- GitHub, Jenkins, Azure DevOps, Terraform, and CI/CD
- Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana comprise the BI Analytics Tool Stack.
- DataStage and Informatica for Data Warehousing
- Privacy and Data Governance: Informatica Axon and EDC, BigID
Prior work experience and education are preferred qualifications.
- 5+ years of experience in the design, development, and implementation of large-scale applications or data engineering solutions employing an agile, dev ops, product approach.
- 5+ years of SQL data analytics experience
- 3+ years of experience in full-stack development, ideally in Azure
- Experience with Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for at least three years (prefer Microsoft Azure).
- Experience in the airline industry
Knowledge, Permits, and Certifications
- Knowledge of data management, ingestion, capture, processing, curation, and layer creation using the Azure Technology stack.
- Knowledge of giving useful guidance within Azure Native cloud services.
- Certification for the Azure Development Track (recommended)
- Certification by Spark (recommended)