Calculus Leibniz' notation

I'm currently doing integration by parts, and I'm finding that the notation is what makes it tough for me. So I looked it up and found that:

$$\int u(x)v'(x)dx= u(x)v(x) - \int u'(x)v(x)dx$$

But the wikipedia said that this above equality is the same as:

$$\int u dv = uv - \int v du$$

I think I have located my problem: I don't see how these 2 are equal at all. How could for example know that

$$\int u(x)v'(x) dx = \int udv$$

I can't really see the equivalence here.

Answer

The point is that when Leibniz conceived the derivative, he thought of it as the quotient of two infinitely small numbers $dy$ and $dx$ if $y = f(x)$, for example. In that case, the derivative was really written as $dy/dx$, and since $f'(x)=dy/dx$, we have $dy=f'(x)dx$ as the infinitely small quantity that $y$ varies at a rate $f'(x)$ when $x$ varies the infinitely small quantity $dx$.

However, this stuff isn't rigorous. Indeed, in standard analysis, it is impossible to conceive a number like an infinitesimal, and the use of this even as mere notation may lead to confusion. That's why in the modern language, we simply use the prime notation to denote the derivative. The next best thing to replace the infinitesimals $dy$ and $dx$ is the notion of a differential form; there's so much about them to be said that I won't explain here.

So, in truth, if you use this stuff that's not rigorous you have $dv=v'(x)dx$ and $du=u'(x)dx$ so that we can write:

$$\int u(x)v'(x)dx = u(x)v(x)-\int v(x)u'(x)dx$$

Simply as:

$$\int udv = uv - \int v du$$

Now, understand that this last thing is just a mnemonic rule so that people remember what to do when find an integral like that. The rigorous version is the first formula that's derived directly from the product rule for derivatives.

Indeed, many of the notations regarding one-dimensional integrals that refer to "let $u$ be that, then $du$ is that other thing" and so forth are just rules for you to remember easier what to do. As I've said, those $dx$, $du$ and everything else can have a rigorous meaning as differential forms when you study differential geometry.