
Every year, the holiday season is a huge test for a bunch of people.
They are database engineers.
Because there are predictable traffic surge during major campaigns such as Black Friday, Cyber Monday, and Double 11.
Have you ever thought about this:
Why the payment process won’t stuck when hundreds of millions of people pay together?
Because database engineers are showing their power.
Let’s see what database engineers are doing during the holiday season:
Sort out the system chain for the huge campaign
Design the full-chain database flow chart

Predict traffic
Predict the database performance bottleneck
Plan traffic limit rules for critical apps, degrade non-critical apps

System patrol before the huge campaign
Make sure there is enough space to store data and logs

Decide which tables need to re-collect stats info

Optimize slow SQL queries for critical businesses in advance

Sort out where to monitor during traffic surge
Make sure key clusters are under monitoring

Perform stress test against the entire processing path and locate potential bottlenecks in advance

Make incident response plan

Stop auto backup jobs
Avoid IO and network jam for the follower nodes

Look retrospectively at the issues and problems of the past years
Analyze the root causes
Never stumble twice against the same stone

As the super heros behind the scene during holiday season
Database engineers start preparing for this event three months in advance
Is there anything missing here? Let us know by leaving comments below!