The Roman army was the Mother of All Badass Armies. Quite literally, in fact. The classic modern organization with hierarchies of standardized units and subunits was based on organization structures developed by Italophile sixteenth and seventeenth century commanders who were consciously attempting to make a copycat. Thus, in fact, the curious sense of recognition a modern person might get on contemplating the Roman army is by no means accidental.
The Roman army was originally a city-state army roughly on the model of those of Ancient Greece. However different circumstances of Italy, including hilly terrain, caused Rome to develop what is called the Manipular Legion. The legion (originally meaning simply muster) was the basic building block of the Roman army. It was roughly the same as what might be called a reinforced brigade now. It had about four to six thousand soldiers who were citizens and roughly equal number of allied or mercenary troops organized into alae, or wings, some of whom provided specialty skills such as archery and cavalry. The foundation of the army was Rome's citizen soldiers; they wielded the pilum (a short javelin of Etruscan origin with a heavy iron head designed to punch through an enemy's armor and/or embed itself in his shield and weigh it down) and a shortsword similar to that used by the Greeks (the famous gladius wasn't adopted until the Punic Wars when it was copied from Spanish warriors). The Manipular Legion was divided into a number of centuries (commanded by a centurion, naturally). Two centuries made a maniple. The maniples were traditionally arrayed in a checkerboard formation of three lines, with the youngest and most unexperienced soldiers (Hastati, presumably for being originally armed with the hasta pike) in the first line, the more experienced Princeps in the second line, and the pike-armed veteran Triarii in the third. This by the way led to a slang term. When a Roman said "It has come down to the Triarii" he meant "things are tough" because of course the Triarii wouldn't join unless their experience was really needed. In a sense, it both meant that things were dire, but also that it was now the real adults' turn to try and fix things.
After the Punic Wars and the conquest of much of the Mediterranean, the Romans found themselves underprepared to handle the Gallic tribes to the north, who were starting to raid their cities. Then a man named Gaius Marius implemented a solution, now known today as the Marian Reforms. The Manipular structure of the military was replaced by the Cohort structure. A typical Cohort was six centuries of soldiers, for a total of about 480 soldiers strong (with an additional 120 non-combatants who served as support staff), and was about the same size as a battalion. The exception was the First Cohort in an army, which always had roughly 800 total soldiers and 200 support staff, due to being the most senior Cohort and having specialized soldiers in its ranks. These Cohorts were much more tightly-packed than earlier Maniples were, which prevented them from being overwhelmed by their more tribal opponents.
The Marian Reforms also changed the army from a citizen levy to a professional force, by virtue of a 16-year service pledge; being a soldier would be a full-time occupation for much of an adult's life. The property requirements for joining the army were dropped; soldiers would be paid and provisioned by their commander, or later, the state. The equipment was standardized, with all legionaries issued the gladius sword, a large shield (scutum), body armor made of chainmail, scales, or (later) segmented plate, a helmet, and javelins. Non-citizens were recruited into the army as auxiliaries, being rewarded with Roman citizenship upon discharge. Auxiliaries served as archers, cavalrymen, skirmishers, and light infantry, allowing citizens to specialize as heavy infantry. A full Legion saw ten Cohorts, always including the First Cohort with its larger manpower, paired with auxiliaries and cavalry for a total of around 5,400 total soldiers.
The expression goes "all roads lead to Rome"; in fact, the opposite is true. All roads lead FROM Rome and some people happen to walk on them the wrong way. The roads were built by the army on their way to conquest. Further, their every stop for the night was accompanied by building a fortified camp. In the morning, it was dismantled so that enemies couldn't use it. They had no fear of using earthworks and engineering in combat, and on at least one occasion they literally altered the face of the Earth.
Alexander the Great is known to have turned an island into a peninsula because the inhabitants made him angry. Not be topped by some pansy Macedonian, the Legion built a mountain. Why? Because on another mountain there were some rebellious Israelites, and Rome doesn't like rebels. More accurately, the rebels hid in the famous Masada, put on the top of a mountain and impossible to take by force due the only way of approach was a very narrow path. In order to root them out, the Legion built a ramp from ground level all the way to the top of the mountain, so they would be able to approach in proper formation and their siege engines. Then they killed the rebels (or would have, if they didn't all commit suicide). If the mountain came to Mohammed, it may be because Rome brought it to him.
In terms of arms and armament, each legionary carried a gladius, and two pila. The gladius was the Roman short sword, intended more for thrusting than for slashing. The pilum was a short javelin with a wooden haft and a long iron point. The javelin could and did kill, but it was also very useful in disabling enemy shields. After sticking in the shield, the soft iron would bend, making it difficult to remove (the barbed head also helped) meaning that the enemy's shield would be burdened with an extra ten pounds of off-balance iron. The soft iron designed to bend on impact also ensured that the enemy soldier couldn't just pick up the pilum and throw it back at the legionnaire.
In terms of armor, the movies sometimes get this right; they wore "lorica segmentata" which was heavy iron cuirasses made up of many metal strips fastened by leather straps over wool padding (...for at least over a hundred years. Otherwise, they used mail armor which they named lorica hamata which certainly preceded lorica segmentata for centuries and probably later supplanted it again for unclear reasons. We'd forgive you if you never saw the mail armor on Roman soldiers before anyway), hardened leather skirts, and heavy boots. The design of the helmet reflected their focus on slashing swordplay, as it protected the top and side of the heads, but not the face. Contrast this with the design of Greek helmets which protected the face from the thrusts of fifteen-foot long spears (and, later, eighteen-foot pikes under Philip and Alexander of Macedon). The plumes and such that you see on TV (and at casinos) were actually reserved for officers as an identifier of rank.
The term "legion" was somewhat similar to the modern term "regiment" or "battalion", denoting a portion of the army of a particular size. During the height of the direct (as opposed to hegemonic) empire, the legions spent their time at the outskirts of the empire maintaining control. The more troublesome a region, the more legions it received. Thus Iberia (modern Spain) only had one legion, but Judea (modern Israel, Jordan, and surrounding countries) had three. Britain was troublesome enough to warrant four, and these legions would frequently be used by usurpers.
Each legion was divided into ten cohorts named "first cohort", "second cohort" and so on. The first cohort was the most prestigious, the tenth the least. Each cohort was divided into six centuries containing ~80 (not one hundred) men, led by a centurion. In terms of seniority, the centurion of the first century of the first cohort was the most senior officer and that of the sixth century of the tenth cohort the most junior. All told, the legion had a strength of approximately 5,400 men, once officers, engineers, and auxiliary cavalry were accounted for.
Speaking of auxiliary, the legion was beloved by Rome and it was truly a fearsome heavy infantry and the backbone of the Roman army. That said, the Romans weren't stupid and knew that victory relies on the ability of the army to meet the enemy regardless, and auxiliary forces were used to supplement the legion. The auxiliary units comprised light and heavy cavalry, archers, and sling-men. They were made up not of Roman citizens, but of citizens of captured, absorbed, or client states. Only Roman citizens could become legionaries. However, serving in the auxiliary was a path to citizenship, so the children of auxiliaries could become legionaries. Over time, this led to difficulty as it meant that there were fewer people available for the auxiliaries, which, despite the fame and esteem of the legions, truly were necessary for a balanced and viable fighting force.
One last note: the term decimation is Latin and literally means "destruction of one in ten". Any demonstration of cowardice or mutiny was punished by decimation. The unit was divided into groups of ten and the men drew lots. Whoever got the short straw was beaten to death by the other nine. Officers tended to be executed separately from the rank and file. Such an extreme measure was only used a handful of times in Rome's history.
The Roman army continued to evolve for a long time. Toward the later days it was almost indistinguishable from a feudal army. The Roman forces in the Eastern Empire, however were able to maintain a shadow of the old-school professionalism for a long time, having survived the destruction of the Western Empire by nearly 1,000 years.