TikaDocumentConverter does not split content by page

[vaclcer]

The Documents generated by "TikaDocumentConverter" from PDF files do not contain "\f" page separators, so later in the pipeline the "DocumentSplitter" then cannot split them by page and generates one big "page" with all the text.

The page separation works as expected with using "PyPDFToDocument".

[anakin87]

Thanks, @vaclcer!

For context, TikaDocumentConverter split documents by page in v1.x (v1.x TikaConverter), so it might make sense to see if the logic is still valid and port it to v2.x.

[ghost]

Hello,
I'm new to contributing to open-source.
Can I take a shot at this?

[AnushreeBannadabhavi]

I'd like to take this up if no one is working on it

[anakin87]

@AnushreeBannadabhavi feel free to work on this! 💙

(the user who had commented earlier removed his GitHub profile)