First of all, don't give up! This isn't a competition, so you don't need to measure yourself with the perceived achievements of the others. It's not an even field either. For example, I started learning about computers back in 1985 and haven't stopped since. I knew a lot of the stuff already, so I found some parts easy. But I still learned a tremendous amount from this course.
I can also suggest the book
Code: The Hidden Language of Computer Hardware and Software by Charles Petzold. It tackles very similar problems, but has a bit different focus. It may help you better understand some of the concepts. I think Code and Elements nicely complement each other.