Full Time
Associate Data Engineer – Remote Overnight Jobs
Job Description
Job Type: Associate Data Engineer from home
Location: Arizona work from home
Company: American Airlines
Responsibilities:
As stated above, this list is meant to reflect the current position; nevertheless, there may be other critical job tasks that are not mentioned that are just as important, if not more so. When it is judged necessary, management may alter the job or assign new duties, as long as it complies with all applicable laws and any collective bargaining agreements.
- Design, build, and support analytics solutions that offer insights to help make smarter decisions in close collaboration with source data application teams and product owners.
- Utilize Azure services and products (such as Azure Data Factory, Azure Data Factory Storage, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) as well as conventional data warehouse technologies to implement data migration and data engineering solutions.
- Design, cloud engineering (Infrastructure, Network, Security, and Administration), Ingestion, Preparation, Data Modeling, Testing, CICD Pipelines, Performance Tuning, Deployments, Consumption, BI, Alerting, and Prod Support are just a few of the tasks that need to be performed.
- Give technical assistance, work in a group setting, and both alone and independently
- Join a DevOps team that fully controls and maintains its product.
- Utilize cloud technology to implement batch and streaming data pipelines.
- Creates coding standards, best practices, and security and privacy policies
Requirements:
Minimum requirements include education and previous work experience.
- A bachelor’s degree in engineering, technology, information systems (CIS/MIS), computer science, or a closely related technical field, or comparable experience or training
- 2 years of experience creating software solutions using agile and DevOps while working within a product model that include creating, deploying, and managing large-scale apps or data engineering solutions
- 2 years of SQL data analytics experience
- 1 year of experience using Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for cloud development and data lakes (prefer Microsoft Azure).
- Experience in a variety of the following tools/platforms, including Development, Administration, and Support, is required:
- Python, Spark, Unix, and SQL scripting
- Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake, and Azure Data Explorer are a few examples of data platforms. administrative expertise is a plus
- Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Azure Functions are examples of Azure Cloud Technologies.
- GitHub, Jenkins, Azure DevOps, Terraform, and CI/CD
- Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana comprise the BI Analytics Tool Stack.
- DataStage and Informatica for Data Warehousing
- Privacy and Data Governance: Informatica Axon and EDC, BigID
Prior work experience and education are preferred qualifications.
- 2+ years of experience in the design, development, and implementation of large-scale applications or data engineering solutions employing an agile, dev ops, product approach.
- 2+ years of SQL data analytics experience
- 1 year of experience in full-stack development, ideally in Azure
- Experience with Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps, and Power BI for 1 year (prefer Microsoft Azure).
- Experience in the airline industry
Knowledge, Permits, and Certifications
- Knowledge of data management, data intake, data capture, data processing, data curation, and building consumption layers.
- Certification for Azure Development Track
- Certification by Spark
