How to Build Production-Ready Microservices Michael Kehoe Staff

How to Build Production-Ready Microservices Michael Kehoe Staff

How to Build Production-Ready Microservices Michael Kehoe Staff Site Reliability Engineer Todays agenda 1 Introductions

2 Tenets of Readiness 3 Creating Measurable guidelines 4

Measuring readiness 5 Key Learnings 6 Q&A Introduction

Michael Kehoe $ WHOAMI Staff Site Reliability Engineer @ LinkedIn Production-SRE Team

Funny accent = Australian + 4 years American Worked on:

Networks Microservices Traffic Engineering Production-SRE Team @ LinkedIn $ WHOAMI

Disaster Recovery - Planning & Automation Incident Response Process & Automation Visibility Engineering Making use

of operational data Reliability Principles Defining best practice & automating it What is a Production Ready Service? Production-Ready

Microservices Susan J. Fowler OReilly 2017 A production-ready application or service is one that can be trusted to serve production traffic SUSAN J. FOWLER We trust it to behave reasonably, we trust it to perform reliably, we trust it to

get the job done and to do its job well with very little downtime. SUSAN J. FOWLER Tenets of readiness Tenets of Readine ss

1 Stability & Reliability 2 Scalability & Performance 3 Fault Tolerance and DR

4 Monitoring 5 Documentation Stability & Reliability

Tenets of Readiness STABILITY Stable development cycle Stable deployment cycle Tenets of Readiness

RELIABILITY Dependency Management Onboarding + Deprecation procedures

Routing + Discovery Scalability & Performance Tenets of Readiness SCALABILITY Understanding growth-scales

Resource awareness Dependency scaling Tenets of Readiness PERFORMANCE

Constant performance evaluation Traffic management Capacity Planning

Fault Tolerance & DR Tenets of Readiness FAULT TOLERANCE Avoiding Single Points of Failure (SPOF)

Resiliency Engineering Tenets of Readiness DISASTER RECOVERY Understand failure scenarios Disaster Recovery Plans

Incident Management Monitoring Tenets of Readiness MONITORING

Dashboards + Alerting for: Service Resource Allocation

Infrastructure All alerts are actionable and have pre-documented procedures. Logging

Documentation Tenets of Readiness DOCUMENTATION Have one central landing-place for documentation for the service

Review of documentation from Engineer/ SRE/ Partners Reviewed Regularly Tenets of Readiness DOCUMENTATION

What should documentation include: Key information (ports/ hostnames etc) Description

Architecture Diagram API description Oncall information

Onboarding information Creating Measurable Guidelines Creating Measurable Guidelines Not all guidelines directly translate into something measurable

You may need to look outcomes of specific guidance to create measurable guidelines Creating Measurable Guidelines EXAMPLE

Stability: Stable development cycle Stable deployment process

Stable introduction and deprecation procedures Creating Measurable Guidelines EXAMPLE Stable development cycle Is the unit-test coverage above X

%? Has this code-base been built in the last week? Is there a staging environment for the application?

Creating Measurable Guidelines EXAMPLE Stable deployment process Has the application been deployed recently?

What is the successful deployment percentage? Measuring Readiness Measuring Readiness WHY? Standardizati

on Ensuring that services are built and operated in a standard manner Quality Assurance Ensuring that services are trustworthy

Measuring Readiness HOW? Manual Checklists Create a manual checklist Automated

Scorecards Automate the discovery and measurement of readiness Automated Scorecards Service Score Card Automated Service Discovery

Breakdown of scores by team Automated Scorecards Service Score Card Team Overview Automated Scorecards Service Score Card

Breakdown of readiness results Key Learnings Key Learnings Create Automate

Evangelize A set of guidelines for what it means for your service to be ready Automate the checking and scoring of these guidelines

Set the expectation between Engineering/ Product/ SRE that these guidelines have to be met Q&A

Recently Viewed Presentations

  • Craniosynostosis: a case of Apert Syndrome

    Craniosynostosis: a case of Apert Syndrome

    Apert syndrome. ADD. Speech delay. PSurgHx. R syndactyly release "Hip" surgery. FamHx. ... Bi-frontal craniotomy. Recontouring of frontal bone with barrel staves and burring. Dissection down to foramen cecum. Gingival incisions . Osteotomies - zygomatic arches, sphenoids, orbits, posterior ...
  • socialwork.uw.edu

    socialwork.uw.edu

    Don't spoil the ending, but give a sense of what information or understanding may be gained by reading your paper ... Give the highlights! ... Use numerals (1, 2, 5) to refer to figure numbers, not words (one, two, five)...
  • NWSC Math Cohort Meeting - nw-service.k12.mn.us

    NWSC Math Cohort Meeting - nw-service.k12.mn.us

    * Support students in applying critical-thinking skills to the counting sequence by presenting number-logic riddles. When students are familiar with format of logic riddles, allow them to create riddles for classmates to solve. ... explaining what the decimal numeral means...
  • Hybrid MMC - peci.ece.illinois.edu

    Hybrid MMC - peci.ece.illinois.edu

    Purdue University *ABB PECI 2016 This work was supported by the Office of Naval Research (ONR) through Grant N00014-08-1-0080 and N00014-14-1-0160 Harish Suryanarayana was partially funded by a fellowship provided by ABB Inc.
  • MarketspaceU - Chapter 3 Enhanced Lecture Slides

    MarketspaceU - Chapter 3 Enhanced Lecture Slides

    Chapter 3 Enhanced Lecture Slides ... via phone Brochure Purchase in-store Purchase via phone In-store specials Specials offered via phone *CSR = Customer service representative Flower / Gift Decision Process Need Recognition Search for Ideas and Offerings Purchase Decision Message...
  • A Recipe for Blending The Five Essential Ingredients Kneaded ...

    A Recipe for Blending The Five Essential Ingredients Kneaded ...

    A Recipe for Blending The Five Essential Ingredients Kneaded For Effective Mathematics Instruction New Wisconsin Promise Conference: Closing the Achievement Gap January 16, 2008 Beth Schefelker, Math Teaching Specialist Milwaukee Public Schools [email protected] Lee Ann Pruske, Teacher in Residence University...
  • The Challenge: To Create More Value in All Negotiations

    The Challenge: To Create More Value in All Negotiations

    X.always MASTER PART TWO 10 MARCH 2007
  • Hertfordshire Partnership NHS Foundation Trust Acute Day Treatment

    Hertfordshire Partnership NHS Foundation Trust Acute Day Treatment

    Crisis Assessment and Treatment Team (CATT), Helen Dudeney and Sarah Biggs. Presented by. Safer Care Pathways in Mental Health. About the service. Crisis Assessment and Treatment Team (CATT) 24 hours crisis assessment and home treatment service as an alternative to...