This was just a speculation.
But he clearly remembered that there was indeed some kind of connection between those fragments.
For instance, the man with a snake face could see what Harry saw through the fragment on Harry's forehead, and even let Harry see what was happening on his side.
And, unfortunately, create dreams to deceive Harry...
