Web scraping not fetching all data from the page

@Dark_matter wrote:

Hi All,

I am trying to fetch Job data from LinkedIn site.

But only 8 records are fetched from the page having 25 records.

Preview data wizard after selecting the second element shows all the 25 records but when i run it, only 8 records are fetched. I tried several ways to form the pattern.

selected 1st record, last record
selected 1st record. second record
selected 9th record, tenth record.

<column exact='1' name='Column1' attr='text'>
	<webctrl tag='div' idx='1'/>
	<webctrl tag='ul' class='jobs-search-results__list artdeco-list' idx='1'/>
	<webctrl tag='li' class='occludable-update artdeco-list__item--offset-4 artdeco-list__item p0 ember-view'/>
	<webctrl tag='div'/>
	<webctrl tag='artdeco-entity-lockup' class='artdeco-entity-lockup--size-4 artdeco-entity-lockup ember-view' idx='1'/>
	<webctrl tag='artdeco-entity-lockup-content' class='job-card-search__content-wrapper artdeco-entity-lockup__content ember-view' idx='1'/>
	<webctrl tag='h3' class='job-card-search__title artdeco-entity-lockup__title ember-view' idx='1'/>
</column>

Link: Login into LinkedIn -> to go Jobs page -> Search for ‘Data science’ and ‘United Kingdom’ -> I am trying to search this page.

Could you please help me here?

Posts: 4

Participants: 2

Read full topic