Lee 发表于 2019-2-25 13:31:50

Azure 大数据 Architect


Big Data (Azure, Hadoop, Spark, Scala)
Experience in coding using Spark Python (must have), Scala, Python, Hive and Elastic Search, and any No-SQL database.
Experience with Microsoft Server products and Azure Platform Technologies SQL Azure, Azure AD, Dynamics 365, and Azure Platform Technologies
Experience handling the data pipeline challenges.
Responsible for BigData/data warehouse pipeline, application design, data quality, implementation, and testing/deployment strategy.
Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the data warehouse or delivery of critical reporting within established SLAs.
Identifies and recommends improvements in production application solutions or operational processes in support of data warehouse applications and business intelligence reporting (ie, data quality, performance, static and dynamic reports, etc.)
Researches manage and coordinate the resolution of complex issues through root cause analysis as appropriate


Should be able to benchmark systems, analyze system bottlenecks and propose solutions to eliminate them, especially Data lake implementation.
Should be able to clearly articulate the pros and cons of various technologies and platforms;
To be able to document use cases, solutions, and recommendations;
Should have excellent written and verbal communication skills;
Should be able to perform detailed analysis of business problems and technical environments and use this in designing the solution;
should be able to build and mentor the team around new technologies.
Should be able to work in teams, as a big data environment is developed in a team of employees with different disciplines;
Should be able to work in a fast-paced agile development environment.

Functional Skills

Bachelor's degree or equivalent experience in Information Technology
Proven experience working with an offshore support team
Previous experience working in a high paced, high-pressure agile development environment
Proven analytical and problem-solving skills for assessment of complex requirement, production support issues and recommend/implement effective solutions
Natural technical and functional curiosity
Excellent communication skills

Technical Skills

7 + years of IT experience with at least 3 years of experience in Spark/Python, Spark/Scala. (must have)
Spark/Python/Scala, Hive, HDFS, Pig, and other Big Data Technologies.
Experience with various databases (SQL, NoSQL)

Education Qualification
Master's/Bachelor's Degree in computer science, robotics, mathematics, statistics, or related quantitative field.

Location:NYC, USA

application: send resume to: [email protected]
页: [1]
查看完整版本: Azure 大数据 Architect