Your age and the timeframe you are looking at shouldn’t be a bar for qualifying the Civil Services Exam. As for the question whether you are late to the scene, I would say you are definitely late.
Many aspirants clear the exam right out of college these days and hence if you are looking only the apex post that you will reach at the end of your career, then your age is definitely a bar. Whether you reach that post will depend on a lot of things that are outside your control.
For everything else, I consider 24 as the perfect age to start preparing for the CSE. I started at 25 and I too put in around 2 years for clearing the exam. The difference in your approach and maturity as a 22 year old and as a 24–26 year old is very different.
Make no mistake. I am not saying that it would be a cakewalk clearing the exam in 2 years. You need considerable hardwork and luck on your side to pass the Civil Services Exam. This is an exam that roughly 5 lakh people attempt (in a year). Some people clear it in the first attempt, some in their fifth, some never do. Be awake to that risk. There is nothing much that can be done about the chance factor. Put in your best effort and study smartly. If you are not particularly unlucky, you can definitely make it to the final list.