"Point", "line", "plane", etc. in this context are "primitive" notions; thus we don't say what they are but we speak of relationships among them.
Suppose your math teacher tells you that 3 is less than 5.
Does that mean three apples are fewer than five apples?
Does it mean three gallons of gasoline is less than five gallons of gasoline?
Does it mean three dollars is less money than five dollars?
Does it mean a committee of three persons has fewer members than a committee of five?
Does it mean three pages of a book are a shorter passage than five pages?
Does it mean three days is a shorter time than five days?
Does it mean that three prime numbers are fewer than five prime numbers?
Does it mean three ideas about how to govern a country are fewer than five ideas?
And so on. As mathematicians, when we say $3<5$ we don't know whether we're talking about apples, or gallons of gasoline, or dollars, or persons, or pages of a book, or days, or prime numbers, or ideas. As Bertrand Russell put it "Mathematics is the subject in which we don't know what we're talking about." Three things are fewer than five things and we as mathematicians don't know what things are; the word thing is undefined. In applications of mathematics, we know what the things are, but the mathematical fact that we apply to "things", the fact that $3<5$, is the same regardless.
In an algebra course you may learn that a "group" is a set of "things" on which a certain kind of binary operation exists, so that there is a "multiplication" table, thus:
$$
\begin{array}{c|cccccccccccccccc}
\times & e & p & q & r & y & z \\
\hline
e & e & p & q & r & y & z \\
p & p & e & y & z & q & r \\
q & q & z & e & y & r & p \\
r & r & y & z & e & q & q \\
y & y & r & p & q & z & e \\
z & z & q & r & p & e & y
\end{array}
$$
What are these "things" called $e,p,q,r,y,z$? In doing this kind of algebra, we don't know. They are "primitive"; they are undefined. In applications to other areas of mathematics, we may know what they are: in some cases, they are permutations of a set of three objects and the "multiplication" is composition of permutations. In some other cases, they are geometric transformations of one kind or another.
How many partitions of a set of four "things" exist? A mathematician can tell you the answer is $15$ without knowing what the undefined "things" are:
$abcd$
$abc/d$
$abd/c$
$acd/b$
$bcd/a$
$ab/cd$
$ac/bd$
$ad/bc$
$ab/c/d$
$ac/b/d$
$ad/b/c$
$bc/a/d$
$bd/a/c$
$cd/a/b$
$a/b/c/d$
Mathematics generally works in that way with undefined "things".
As for geometry, not all applications of geometry are applications to physical space. The "points" in such applications may not be points in physical space. For example, in statistics, suppose each number in a list of numbers is decomposed into the average of the numbers in the list and the deviation from the average, thus:
$$
(99, 97, 103, 101) = (100,100,100,100) + (-1,-3,+3,+1)
$$
Looking at this geometrically, we say that the vector in which every component is $100,$ the average, is the orthogonal projection of the point we started with onto a $1$-dimensional space, and the vector of deviations from the average is the projection onto the complementary $3$-dimensional subspace. Such geometry enables us to prove in some contexts that the sample mean and the sample standard deviation are independent random variables, and knowing that is crucial to finding the probability distribution of a statistic used in finding a confidence interval for the population mean.
Thus in some appliations the "points" in geometry may be locations in physical space; and in some they may be statistical data sets, but the geometry is the same either way.