Data Engineer

Job Title :- Data Engineer

Job Location :- Nashville, TN Remote As of now

Description:

Should have 10+ Years of experience into IT.

Duties & Responsibilities: What major responsibilities does this position have and what percentage of time is spent on completing them? (Typically, 5 7)

• Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
• Analyse and organize raw data
• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results
• Prepare data for prescriptive and predictive modelling
• Build algorithms and prototypes

Knowledge, Skills and Abilities (KSAs): What KSAs are required to perform this job?

• Knowledge of programming languages (e.g. Java and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Degree in Computer Science, IT, or similar field; a Master's is a plus
• Data engineering certification (e.g IBM Certified Data Engineer) is a plus
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc

Work Experience &/or Education:

• What are the minimum education and/or experience requirements necessary to perform this job?
• Degree in information technology or computer science with additional vendor-specific certification.