KR 2021 homework part 1 - Redigeerimiste ajalugu

Tammet: /* Conceptnet */

2023-01-31T11:09:54Z

Conceptnet

←Vanem redaktsioon		Redaktsioon: 31. jaanuar 2023, kell 13:09
47. rida:		47. rida:
	* If yes, please store the relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.		* If yes, please store the relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.

	= Conceptnet =		== Conceptnet ==

	Similarly to Quasimodo, explore, and if it makes sense, use [http://conceptnet5.media.mit.edu/ conceptnet]. This contains a lot more than Quasimodo, but does not have as good metainformation (context, plausibility, etc).		Similarly to Quasimodo, explore, and if it makes sense, use [http://conceptnet5.media.mit.edu/ conceptnet]. This contains a lot more than Quasimodo, but does not have as good metainformation (context, plausibility, etc).

Tammet: /* Ascent++ */

2023-01-31T11:09:41Z

Ascent++

←Vanem redaktsioon		Redaktsioon: 31. jaanuar 2023, kell 13:09
57. rida:		57. rida:
	* If yes, please store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json. Since Conceptnet is big, do not attempt to store all the seemingly relevant information.		* If yes, please store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json. Since Conceptnet is big, do not attempt to store all the seemingly relevant information.

	= Ascent++ =		== Ascent++ ==

	* Check out the newest Max Planck dataset [https://ascentpp.mpi-inf.mpg.de/ ascent++], explore the data, read the paper.		* Check out the newest Max Planck dataset [https://ascentpp.mpi-inf.mpg.de/ ascent++], explore the data, read the paper.

	* If some parts look useful, please filter these out and store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.		* If some parts look useful, please filter these out and store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.

Tammet – 31. jaanuar 2023, kell 11:09

2023-01-31T11:09:27Z

←Vanem redaktsioon		Redaktsioon: 31. jaanuar 2023, kell 13:09
29. rida:		29. rida:
	* perform some sample queries to verify that you can actually find information: try searching for both simple facts and also using taxonomies for searching for more abstract concepts.		* perform some sample queries to verify that you can actually find information: try searching for both simple facts and also using taxonomies for searching for more abstract concepts.

	= ~~Quasimodo for~~ basic commonsense knowledge =		= Extras =

			It is a good idea - but not at all obligatory! - to explore the following basic commonsense knowledge datasets, find if you can get useful additional information for the geography domain, filter it out and store in the database.

			== Quasimodo ==

	As a source for basic commonsense knowledge we explore and possibly use [https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/yago-naga/commonsense/quasimodo quasimodo]. Beware: it does not cover very much and contains a lot of weird statements, like "estonia, has_color, yellow".		As a source for basic commonsense knowledge we explore and possibly use [https://www.mpi-inf.mpg.de/departments/databases-and-information-systems/research/yago-naga/commonsense/quasimodo quasimodo]. Beware: it does not cover very much and contains a lot of weird statements, like "estonia, has_color, yellow".
43. rida:		47. rida:
	* If yes, please store the relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.		* If yes, please store the relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.

	= Conceptnet ~~for basic commonsense knowledge~~ =		= Conceptnet =

	Similarly to Quasimodo, explore, and if it makes sense, use [http://conceptnet5.media.mit.edu/ conceptnet]. This contains a lot more than Quasimodo, but does not have as good metainformation (context, plausibility, etc).		Similarly to Quasimodo, explore, and if it makes sense, use [http://conceptnet5.media.mit.edu/ conceptnet]. This contains a lot more than Quasimodo, but does not have as good metainformation (context, plausibility, etc).
52. rida:		56. rida:

	* If yes, please store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json. Since Conceptnet is big, do not attempt to store all the seemingly relevant information.		* If yes, please store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json. Since Conceptnet is big, do not attempt to store all the seemingly relevant information.

			= Ascent++ =

			* Check out the newest Max Planck dataset [https://ascentpp.mpi-inf.mpg.de/ ascent++], explore the data, read the paper.

			* If some parts look useful, please filter these out and store a significant amout of relevant meaningful information part in the SQL database, using both standard SQL and, where it seems useful, json.

Tammet: /* Quasimodo for basic commonsense knowledge */

2023-01-31T11:03:29Z

Quasimodo for basic commonsense knowledge

←Vanem redaktsioon		Redaktsioon: 31. jaanuar 2023, kell 13:03
35. rida:		35. rida:
	In particular, please		In particular, please

	* Read the [https://arxiv.org/pdf/1905.10989.pdf paper] and explore [https://quasimodo.r2.~~enst~~.fr/ the ~~demo~~]		* Read the [https://arxiv.org/pdf/1905.10989.pdf paper] and explore [https://quasimodo.mpi-inf.mpg.de/ the exploration page]

	* Download and explore the [https://www.mpi-inf.mpg.de/fileadmin/inf/d5/research/quasimodo/quasimodo-v1.3.zip version 1.3 dataset].		* Download and explore the [https://www.mpi-inf.mpg.de/fileadmin/inf/d5/research/quasimodo/quasimodo-v1.3.zip version 1.3 dataset].

Tammet – 2. veebruar 2022, kell 13:55

2022-02-02T13:55:08Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 15:55
3. rida:		3. rida:
	Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".		Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".

	In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or [https://avi.im/blag/2021/fast-sqlite-inserts/ this] or google analogous tips.		In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or [https://avi.im/blag/2021/fast-sqlite-inserts/ this] or google analogous tips. For postgres search analogous tips to make bulk inserts several orders of mangitude faster than with the naive insertion.

	If you have very little or no experience using SQL, then it is recommended to		If you have very little or no experience using SQL, then it is recommended to

Tammet – 2. veebruar 2022, kell 13:21

2022-02-02T13:21:03Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 15:21
3. rida:		3. rida:
	Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".		Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".

	In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or [https://avi.im/blag/2021/fast-sqlite-inserts/ ~~same with python examples~~] or google analogous tips.		In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or [https://avi.im/blag/2021/fast-sqlite-inserts/ this] or google analogous tips.

	If you have very little or no experience using SQL, then it is recommended to		If you have very little or no experience using SQL, then it is recommended to

Tammet – 2. veebruar 2022, kell 13:19

2022-02-02T13:19:59Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 15:19
3. rida:		3. rida:
	Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".		Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".

	In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or google analogous tips.		In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or [https://avi.im/blag/2021/fast-sqlite-inserts/ same with python examples] or google analogous tips.

	If you have very little or no experience using SQL, then it is recommended to		If you have very little or no experience using SQL, then it is recommended to

Tammet – 2. veebruar 2022, kell 13:17

2022-02-02T13:17:48Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 15:17
2. rida:		2. rida:

	Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".		Since the goal really is <font color="red">first exploring and then converting the data</font>, there is no exact specification in the style of "take this and do that".

			In case you use sqlite, first check out [https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite how to speed up inserts ca 1000 times] or google analogous tips.

	If you have very little or no experience using SQL, then it is recommended to		If you have very little or no experience using SQL, then it is recommended to

Tammet – 2. veebruar 2022, kell 06:57

2022-02-02T06:57:41Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 08:57
9. rida:		9. rida:
	* Read and try out live examples from the [https://www.w3schools.com/sql/sql_intro.asp w3schools SQL tutorial]: at least from the beginning up to the "delete" chapter and then the first few of the "join" chapters.		* Read and try out live examples from the [https://www.w3schools.com/sql/sql_intro.asp w3schools SQL tutorial]: at least from the beginning up to the "delete" chapter and then the first few of the "join" chapters.
	* Look for the specific details and options of using sqlite in python from the [https://docs.python.org/3/library/sqlite3.html python 3 sqlite api docs]		* Look for the specific details and options of using sqlite in python from the [https://docs.python.org/3/library/sqlite3.html python 3 sqlite api docs]
			* Do not worry about sql injection or such security stuff: your code will not be accessible from the web and nobody can attack it using sql injection.

	= Yago for geodata =		= Yago for geodata =

Tammet – 2. veebruar 2022, kell 06:55

2022-02-02T06:55:47Z

←Vanem redaktsioon		Redaktsioon: 2. veebruar 2022, kell 08:55
8. rida:		8. rida:
	* Run this small example from python: kuidas [[sqlite kasutada]]		* Run this small example from python: kuidas [[sqlite kasutada]]
	* Read and try out live examples from the [https://www.w3schools.com/sql/sql_intro.asp w3schools SQL tutorial]: at least from the beginning up to the "delete" chapter and then the first few of the "join" chapters.		* Read and try out live examples from the [https://www.w3schools.com/sql/sql_intro.asp w3schools SQL tutorial]: at least from the beginning up to the "delete" chapter and then the first few of the "join" chapters.
			* Look for the specific details and options of using sqlite in python from the [https://docs.python.org/3/library/sqlite3.html python 3 sqlite api docs]

	= Yago for geodata =		= Yago for geodata =