web scarping with flutter

[mohammedsag]

Select Topic Area

Question

Body

div class="S-product-item__name">بنطلون نوم بطباعة ترتان وكاروهات جينغهام - 3 قطع

how can read this with flutter like price and item id

[mahmoud-mohasseb]

Here is parser package and http
read the following topic on geeksforgeeks
https://www.geeksforgeeks.org/web-scraping-in-flutter/

import 'package:flutter/material.dart';
import 'package:html/parser.dart' as parser;
import 'package:http/http.dart' as http;

void main() => runApp(MaterialApp(
theme: ThemeData(
accentColor: Colors.green,
scaffoldBackgroundColor: Colors.green[100],
primaryColor: Colors.green,
),
home: MyApp()));

class MyApp extends StatefulWidget {
const MyApp({Key key}) : super(key: key);

@OverRide
_MyAppState createState() => _MyAppState();
}

class _MyAppState extends State {

// Strings to store the extracted Article titles
String result1 = 'Result 1';
String result2 = 'Result 2';
String result3 = 'Result 3';

// boolean to show CircularProgressIndication
// while Web Scraping awaits
bool isLoading = false;

Future<List> extractData() async {

// Getting the response from the targeted url
final response =
	await http.Client().get(Uri.parse('https://www.geeksforgeeks.org/'));

	// Status Code 200 means response has been received successfully
if (response.statusCode == 200) {
	
// Getting the html document from the response
var document = parser.parse(response.body);
try {
	
// Scraping the first article title
	var responseString1 = document
		.getElementsByClassName('articles-list')[0]
		.children[0]
		.children[0]
		.children[0];

	print(responseString1.text.trim());
	
// Scraping the second article title
	var responseString2 = document
		.getElementsByClassName('articles-list')[0]
		.children[1]
		.children[0]
		.children[0];

	print(responseString2.text.trim());
	
// Scraping the third article title
	var responseString3 = document
		.getElementsByClassName('articles-list')[0]
		.children[2]
		.children[0]
		.children[0];

	print(responseString3.text.trim());
	
	// Converting the extracted titles into
	// string and returning a list of Strings
	return [
	responseString1.text.trim(),
	responseString2.text.trim(),
	responseString3.text.trim()
	];
} catch (e) {
	return ['', '', 'ERROR!'];
}
} else {
return ['', '', 'ERROR: ${response.statusCode}.'];
}

}

@OverRide
Widget build(BuildContext context) {
return Scaffold(
appBar: AppBar(title: Text('GeeksForGeeks')),
body: Padding(
padding: const EdgeInsets.all(16.0),
child: Center(
child: Column(
mainAxisAlignment: MainAxisAlignment.center,
children: [

		// if isLoading is true show loader
		// else show Column of Texts
		isLoading
			? CircularProgressIndicator()
			: Column(
				children: [
				Text(result1,
					style: TextStyle(
						fontSize: 20, fontWeight: FontWeight.bold)),
				SizedBox(
					height: MediaQuery.of(context).size.height * 0.05,
				),
				Text(result2,
					style: TextStyle(
						fontSize: 20, fontWeight: FontWeight.bold)),
				SizedBox(
					height: MediaQuery.of(context).size.height * 0.05,
				),
				Text(result3,
					style: TextStyle(
						fontSize: 20, fontWeight: FontWeight.bold)),
				],
			),
		SizedBox(height: MediaQuery.of(context).size.height * 0.08),
		MaterialButton(
		onPressed: () async {
			
		// Setting isLoading true to show the loader
			setState(() {
			isLoading = true;
			});
			
			// Awaiting for web scraping function
			// to return list of strings
			final response = await extractData();
			
			// Setting the received strings to be
			// displayed and making isLoading false
			// to hide the loader
			setState(() {
			result1 = response[0];
			result2 = response[1];
			result3 = response[2];
			isLoading = false;
			});
		},
		child: Text(
			'Scrap Data',
			style: TextStyle(color: Colors.white),
		),
		color: Colors.green,
		)
	],
	)),
),
);

}
}

[mohammedsag]

not work

[mohammedsag]

articles-list class not found in url
https://www.geeksforgeeks.org/

[github-actions[bot]]

🕒 Discussion Activity Reminder 🕒

This Discussion has been labeled as dormant by an automated system for having no activity in the last 60 days. Please consider one the following actions:

1️⃣ Close as Out of Date: If the topic is no longer relevant, close the Discussion as out of date at the bottom of the page.

2️⃣ Provide More Information: Share additional details or context — or let the community know if you've found a solution on your own.

3️⃣ Mark a Reply as Answer: If your question has been answered by a reply, mark the most helpful reply as the solution.

Note: This dormant notification will only apply to Discussions with the Question label. To learn more, see our recent announcement.

Thank you for helping bring this Discussion to a resolution! 💬