Parallel algorithm for improving the performance of spatial queries in SQL: The use cases of SQLite/SpatiaLite and PostgreSQL/PostGIS databases
This paper proposes an open-source algorithm that performs parallel processing of spatial queries, during which an initial selection of objects to be subjected to spatial relationship tests is done using a spatial index. These data are then further subdivided by the use of the OFFSET and LIMIT claus...
Saved in:
| Published in | Computers & geosciences Vol. 155; p. 104840 |
|---|---|
| Main Author | |
| Format | Journal Article |
| Language | English |
| Published |
Elsevier Ltd
01.10.2021
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0098-3004 1873-7803 |
| DOI | 10.1016/j.cageo.2021.104840 |
Cover
| Abstract | This paper proposes an open-source algorithm that performs parallel processing of spatial queries, during which an initial selection of objects to be subjected to spatial relationship tests is done using a spatial index. These data are then further subdivided by the use of the OFFSET and LIMIT clauses into still smaller subgroups, to which spatial relationship tests utilizing complex calculations are assigned, thereby creating multiple processes running in parallel. This algorithm was tested using data from the SQLite/SpatiaLite and PostgreSQL/PostGIS database. In processing spatial relationship queries involving six threads, the algorithm yielded a 3.6X maximum speed-up increase in performance compared to single-thread processing on SQLite/SpatiaLite database and 5.1X maximum speed-up on PostgreSQL/PostGIS database. In single-layer analyses (e.g., area calculation, buffer generation), a 5X speed-up time in query processing was observed.
•New method of multithreaded use of the SQLite/SpatiaLite and PostgreSQL/PostGIS database.•Open source Python code for parallel spatial relationship queries in SQL.•Intersects, touches, within and crosses spatial relationship was tested.•5.1X maximum speed-up time was observed on spatial relationship query. |
|---|---|
| AbstractList | This paper proposes an open-source algorithm that performs parallel processing of spatial queries, during which an initial selection of objects to be subjected to spatial relationship tests is done using a spatial index. These data are then further subdivided by the use of the OFFSET and LIMIT clauses into still smaller subgroups, to which spatial relationship tests utilizing complex calculations are assigned, thereby creating multiple processes running in parallel. This algorithm was tested using data from the SQLite/SpatiaLite and PostgreSQL/PostGIS database. In processing spatial relationship queries involving six threads, the algorithm yielded a 3.6X maximum speed-up increase in performance compared to single-thread processing on SQLite/SpatiaLite database and 5.1X maximum speed-up on PostgreSQL/PostGIS database. In single-layer analyses (e.g., area calculation, buffer generation), a 5X speed-up time in query processing was observed.
•New method of multithreaded use of the SQLite/SpatiaLite and PostgreSQL/PostGIS database.•Open source Python code for parallel spatial relationship queries in SQL.•Intersects, touches, within and crosses spatial relationship was tested.•5.1X maximum speed-up time was observed on spatial relationship query. This paper proposes an open-source algorithm that performs parallel processing of spatial queries, during which an initial selection of objects to be subjected to spatial relationship tests is done using a spatial index. These data are then further subdivided by the use of the OFFSET and LIMIT clauses into still smaller subgroups, to which spatial relationship tests utilizing complex calculations are assigned, thereby creating multiple processes running in parallel. This algorithm was tested using data from the SQLite/SpatiaLite and PostgreSQL/PostGIS database. In processing spatial relationship queries involving six threads, the algorithm yielded a 3.6X maximum speed-up increase in performance compared to single-thread processing on SQLite/SpatiaLite database and 5.1X maximum speed-up on PostgreSQL/PostGIS database. In single-layer analyses (e.g., area calculation, buffer generation), a 5X speed-up time in query processing was observed. |
| ArticleNumber | 104840 |
| Author | Ilba, Mateusz |
| Author_xml | – sequence: 1 givenname: Mateusz orcidid: 0000-0003-1005-5323 surname: Ilba fullname: Ilba, Mateusz email: ilbam@uek.krakow.pl organization: Department of Social and Economic Geography, Cracow University of Economics, Cracow, Poland |
| BookMark | eNqFkMFu1DAQhi1UJLaFJ-DiI5fsju2kjpE4oApKpZUo2nK2Js5k61USL7a3Ek_BK-N0OXGAk0f__J-l-S7ZxRxmYuytgLUAcb05rB3uKawlSFGSuq3hBVuJVqtKt6Au2ArAtJUCqF-xy5QOACBl26zYr3uMOI40chz3Ifr8OPEhRO6nYwxPft7z_Ej8SLGEE86OeBh4OmL2OPIfJ4qeEvcz333bvucPpXpKxB2mkpZiSX2mze65v4wc557fh5T3kcpys4y3dzveY8ZuoV6zlwOOid78ea_Y98-fHm6-VNuvt3c3H7cVytbkCq8HAaA7M0CroZZGlosabRpwrjFK1V3Z4dCJutaIPRowqmuk69ygQPdCXbF353_LmeWMlO3kk6NxxJnCKVnZ6Fo1stW6VNW56mJIKdJgj9FPGH9aAXbRbw_2Wb9d9Nuz_kKZvyjnc9EQ5hzRj_9hP5xZKgaePEWbnKciv_eRXLZ98P_kfwNvCqQ8 |
| CitedBy_id | crossref_primary_10_24193_JSSPSI_01_CSPTER crossref_primary_10_1155_2022_1337048 crossref_primary_10_1155_2023_5187602 crossref_primary_10_3390_ijgi14030110 crossref_primary_10_1016_j_ecolind_2023_110455 |
| Cites_doi | 10.1016/j.procs.2018.05.088 10.1007/s41324-016-0059-1 10.1016/j.procs.2012.04.205 10.1016/j.autcon.2017.03.014 10.1016/j.is.2014.09.005 10.1145/1327452.1327492 10.1016/j.is.2018.09.004 10.1016/j.eswa.2013.08.027 10.1016/j.eswa.2015.01.011 10.1016/j.fcij.2018.09.002 10.1016/j.jpdc.2013.03.015 10.1016/j.cageo.2014.01.014 10.1016/j.cageo.2018.03.011 10.1016/j.compeleceng.2016.12.014 10.1023/A:1009755931056 10.1016/j.cageo.2017.05.014 10.1016/j.cageo.2019.06.003 10.1016/j.parco.2003.05.003 10.1007/s11235-018-0479-4 10.1016/j.cageo.2012.08.021 10.1016/j.jss.2017.07.005 10.1016/j.is.2014.01.005 |
| ContentType | Journal Article |
| Copyright | 2021 Elsevier Ltd |
| Copyright_xml | – notice: 2021 Elsevier Ltd |
| DBID | AAYXX CITATION 7S9 L.6 |
| DOI | 10.1016/j.cageo.2021.104840 |
| DatabaseName | CrossRef AGRICOLA AGRICOLA - Academic |
| DatabaseTitle | CrossRef AGRICOLA AGRICOLA - Academic |
| DatabaseTitleList | AGRICOLA |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Geology |
| EISSN | 1873-7803 |
| ExternalDocumentID | 10_1016_j_cageo_2021_104840 S0098300421001382 |
| GroupedDBID | --K --M .DC .~1 0R~ 1B1 1RT 1~. 1~5 29F 4.4 457 4G. 5GY 5VS 7-5 71M 8P~ 9JN AABNK AACTN AAEDT AAEDW AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAXUO AAYFN ABBOA ABFNM ABMAC ABQEM ABQYD ABXDB ABYKQ ACDAQ ACGFS ACLVX ACNNM ACRLP ACSBN ACZNC ADBBV ADEZE ADJOM ADMUD AEBSH AEKER AENEX AFKWA AFTJW AGHFR AGUBO AGYEJ AHHHB AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ AOUOD ASPBG ATOGT AVWKF AXJTR AZFZN BKOJK BLXMC CS3 DU5 EBS EFJIC EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-2 G-Q GBLVA GBOLZ HLZ HMA HVGLF HZ~ IHE IMUCA J1W KOM LG9 LY3 M41 MO0 N9A O-L O9- OAUVE OZT P-8 P-9 P2P PC. Q38 R2- RIG ROL RPZ SBC SDF SDG SDP SEP SES SEW SPC SPCBC SSE SSV SSZ T5K TN5 WUQ ZCA ZMT ~02 ~G- AAHBH AATTM AAXKI AAYWO AAYXX ABJNI ABWVN ACLOT ACRPL ACVFH ADCNI ADNMO ADXHL AEIPS AEUPX AFJKZ AFPUW AGQPQ AIGII AIIUN AKBMS AKRWK AKYEP ANKPU APXCP CITATION EFKBS ~HD 7S9 L.6 |
| ID | FETCH-LOGICAL-a289t-a6f1007b9f0870429200057950cc59334b7b9afb1447aada9093b52cbcf307d13 |
| IEDL.DBID | .~1 |
| ISSN | 0098-3004 |
| IngestDate | Sat Sep 27 21:13:06 EDT 2025 Thu Oct 02 04:23:03 EDT 2025 Thu Apr 24 23:12:48 EDT 2025 Fri Feb 23 02:45:10 EST 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Keywords | Spatial data processing Parallel and high performance computing SpatiaLite Algorithms PostGIS |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-a289t-a6f1007b9f0870429200057950cc59334b7b9afb1447aada9093b52cbcf307d13 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ORCID | 0000-0003-1005-5323 |
| PQID | 2574352877 |
| PQPubID | 24069 |
| ParticipantIDs | proquest_miscellaneous_2574352877 crossref_primary_10_1016_j_cageo_2021_104840 crossref_citationtrail_10_1016_j_cageo_2021_104840 elsevier_sciencedirect_doi_10_1016_j_cageo_2021_104840 |
| PublicationCentury | 2000 |
| PublicationDate | October 2021 2021-10-00 20211001 |
| PublicationDateYYYYMMDD | 2021-10-01 |
| PublicationDate_xml | – month: 10 year: 2021 text: October 2021 |
| PublicationDecade | 2020 |
| PublicationTitle | Computers & geosciences |
| PublicationYear | 2021 |
| Publisher | Elsevier Ltd |
| Publisher_xml | – name: Elsevier Ltd |
| References | Python Documentation (bib34) 2019 Beckmann, Kriegel, Schneider, Seeger (bib7) 1990 Adler (bib2) 2001 Solihin, Eastman, Lee (bib45) 2017; 81 SpatiaLite (bib46) 2017 Shehab, Algergawy, Sarhan (bib42) 2017; 57 Guo, Han, Guan, Huang, Xie (bib18) 2020 Papadopoulos, Manolopoulos (bib31) 2003; 29 Dean, Ghemawat (bib12) 2008; 51 Karthi, Prabu (bib27) 2018; 132 Brinkhoff, Kriegel, Seeger (bib8) 1996 Geofabrik (bib16) 2018 Zhang, You, Gruenwald (bib55) 2014; 44 Yao, Mokbel, Alarabi, Eldawy, Yang, Yun (bib52) 2017; 106 Jin, Xie, Wang, Yue (bib25) 2015; 42 Real, Silva (bib38) 2018 Priya, Kalpana (bib33) 2018; 3 SpatiaLite (bib47) 2017 Liu, Ma, Zhang (bib30) 2020; vol. 428 Shvachko, Kuang, Radia, Chansler (bib43) 2010 Dobos, Szüle, Bodnár, Hanyecz, Sebők, Kondor (bib14) 2013 Romero, Herrero, Abelló, Ferrarons (bib39) 2015; 54 Ramsey (bib35) 2019 Simion, Ray, Brown (bib44) 2012; 9 Esri (bib15) 2019 Hagedorn, Räth (bib20) 2017 Guttman (bib19) 1984 Schön, Mosa, Laefer, Bertolotto (bib41) 2013; 51 Tarmur, Özturan (bib49) 2019 Zhou, Abel, Truffet (bib56) 1998; 2 Alomari, Yusoff, Samsudin, Ahmad (bib6) 2019 Dai (bib11) 2009 Hoel, Samet (bib22) 1994 Ilba (bib24) 2020 Hu, Yang, Schnase, Duffy, Xu, Bowen, Lee, Song (bib23) 2018; 115 Ray, Simion, Brown, Johnson (bib37) 2013 Cremer, Bagein, Mahmoudi, Manneback (bib10) 2017; vol. 737 SQLite (bib48) 2020 Zhang, You (bib54) 2012 Aji, Hoang, Wang (bib4) 2015 Addair, Dodge, Walter, Ruppert (bib1) 2014; 66 Xu, Siyamwala, Ghosh, Suri, Awasthi, Guz (bib51) 2015 Carniel, Ciferri, Ciferri (bib9) 2019; 82 Kim, Kim, Nam (bib28) 2013; 73 Vinhas, De Souza, Câmara (bib50) 2003 You, Zhang, Gruenwald (bib53) 2015 Kai (bib26) 2016 Ray, Simion, Brown (bib36) 2011 Agarwal, Rajan (bib3) 2016; 24 Roumelis, Vassilakopoulos, Corral, Manolopoulos (bib40) 2017; 132 Giannousis, Bereta, Karalis, Koubarakis (bib17) 2018 Di Gregorio, Varrazzo (bib13) 2020 Limkar, Jha (bib29) 2019; 70 He, Liu, Ma, Chen (bib21) 2019; 131 Park (bib32) 2014; 41 Aji, Wang, Saltz (bib5) 2012 Hoel (10.1016/j.cageo.2021.104840_bib22) 1994 SQLite (10.1016/j.cageo.2021.104840_bib48) 2020 Adler (10.1016/j.cageo.2021.104840_bib2) 2001 Tarmur (10.1016/j.cageo.2021.104840_bib49) 2019 Park (10.1016/j.cageo.2021.104840_bib32) 2014; 41 Real (10.1016/j.cageo.2021.104840_bib38) 2018 Guo (10.1016/j.cageo.2021.104840_bib18) Aji (10.1016/j.cageo.2021.104840_bib4) 2015 Schön (10.1016/j.cageo.2021.104840_bib41) 2013; 51 Simion (10.1016/j.cageo.2021.104840_bib44) 2012; 9 SpatiaLite (10.1016/j.cageo.2021.104840_bib46) 2017 Carniel (10.1016/j.cageo.2021.104840_bib9) 2019; 82 Alomari (10.1016/j.cageo.2021.104840_bib6) 2019 Ray (10.1016/j.cageo.2021.104840_bib36) 2011 Python Documentation (10.1016/j.cageo.2021.104840_bib34) Hu (10.1016/j.cageo.2021.104840_bib23) 2018; 115 Cremer (10.1016/j.cageo.2021.104840_bib10) 2017; vol. 737 Kai (10.1016/j.cageo.2021.104840_bib26) 2016 Ramsey (10.1016/j.cageo.2021.104840_bib35) Geofabrik (10.1016/j.cageo.2021.104840_bib16) Vinhas (10.1016/j.cageo.2021.104840_bib50) 2003 Xu (10.1016/j.cageo.2021.104840_bib51) 2015 Aji (10.1016/j.cageo.2021.104840_bib5) 2012 Yao (10.1016/j.cageo.2021.104840_bib52) 2017; 106 Ilba (10.1016/j.cageo.2021.104840_bib24) 2020 Jin (10.1016/j.cageo.2021.104840_bib25) 2015; 42 Addair (10.1016/j.cageo.2021.104840_bib1) 2014; 66 Esri (10.1016/j.cageo.2021.104840_bib15) Liu (10.1016/j.cageo.2021.104840_bib30) 2020; vol. 428 Brinkhoff (10.1016/j.cageo.2021.104840_bib8) 1996 Limkar (10.1016/j.cageo.2021.104840_bib29) 2019; 70 Hagedorn (10.1016/j.cageo.2021.104840_bib20) 2017 Ray (10.1016/j.cageo.2021.104840_bib37) 2013 Shvachko (10.1016/j.cageo.2021.104840_bib43) 2010 He (10.1016/j.cageo.2021.104840_bib21) 2019; 131 Priya (10.1016/j.cageo.2021.104840_bib33) 2018; 3 Giannousis (10.1016/j.cageo.2021.104840_bib17) 2018 Di Gregorio (10.1016/j.cageo.2021.104840_bib13) Papadopoulos (10.1016/j.cageo.2021.104840_bib31) 2003; 29 Dobos (10.1016/j.cageo.2021.104840_bib14) 2013 Solihin (10.1016/j.cageo.2021.104840_bib45) 2017; 81 Zhang (10.1016/j.cageo.2021.104840_bib54) 2012 Guttman (10.1016/j.cageo.2021.104840_bib19) 1984 SpatiaLite (10.1016/j.cageo.2021.104840_bib47) 2017 Shehab (10.1016/j.cageo.2021.104840_bib42) 2017; 57 Roumelis (10.1016/j.cageo.2021.104840_bib40) 2017; 132 Beckmann (10.1016/j.cageo.2021.104840_bib7) 1990 Dean (10.1016/j.cageo.2021.104840_bib12) 2008; 51 Kim (10.1016/j.cageo.2021.104840_bib28) 2013; 73 Zhang (10.1016/j.cageo.2021.104840_bib55) 2014; 44 Dai (10.1016/j.cageo.2021.104840_bib11) 2009 Karthi (10.1016/j.cageo.2021.104840_bib27) 2018; 132 Zhou (10.1016/j.cageo.2021.104840_bib56) 1998; 2 You (10.1016/j.cageo.2021.104840_bib53) 2015 Agarwal (10.1016/j.cageo.2021.104840_bib3) 2016; 24 Romero (10.1016/j.cageo.2021.104840_bib39) 2015; 54 |
| References_xml | – volume: 51 start-page: 107 year: 2008 end-page: 113 ident: bib12 article-title: MapReduce: simplified data processing on large clusters publication-title: Commun. ACM – start-page: 289 year: 2013 end-page: 294 ident: bib14 article-title: A multi-terabyte relational database for geo-tagged social network data publication-title: 2013 IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom) – start-page: 1 year: 2010 end-page: 10 ident: bib43 article-title: The hadoop distributed file system publication-title: 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) – start-page: 1 year: 2018 end-page: 5 ident: bib38 article-title: Full speed ahead: 3D spatial database acceleration with GPUs publication-title: 44th International Conference on Very Large Data Bases (VLDB) – volume: 41 start-page: 1294 year: 2014 end-page: 1300 ident: bib32 article-title: Location-based grid-index for spatial query processing publication-title: Expert Syst. Appl. – year: 2020 ident: bib13 article-title: Psycopg: PostgreSQL database adapter for Python – volume: 81 start-page: 369 year: 2017 end-page: 388 ident: bib45 article-title: Multiple representation approach to achieve high-performance spatial queries of 3D BIM data using a relational database publication-title: Autom. ConStruct. – start-page: 9 year: 2019 end-page: 15 ident: bib49 article-title: Parallel classification of spatial points into geographical regions publication-title: 18th International Symposium on Parallel and Distributed Computing – year: 2016 ident: bib26 article-title: A Shared Memory-Based Lock Manager for SQLite on Multicore Platform – year: 2003 ident: bib50 article-title: Image data handling in spatial databases publication-title: GeoInfo 2003, Campos Do Jordão, Brazil – volume: 29 start-page: 1419 year: 2003 end-page: 1444 ident: bib31 article-title: Parallel bulk-loading of spatial data publication-title: Parallel Comput. – year: 2018 ident: bib16 article-title: Geofabrik download server – start-page: 309 year: 2012 end-page: 318 ident: bib5 article-title: Towards building a high performance spatial query system for large scale medical imaging data publication-title: Proceedings of the 20th International Conference on Advances in Geographic Information Systems, Redondo Beach – start-page: 1139 year: 2011 end-page: 1150 ident: bib36 article-title: Jackpine: a benchmark to evaluate spatial database performance publication-title: 2011 IEEE 27th International Conference on Data Engineering – volume: 132 start-page: 165 year: 2017 end-page: 185 ident: bib40 article-title: Efficient query processing on large spatial databases: a performance study publication-title: J. Syst. Software – volume: 57 start-page: 69 year: 2017 end-page: 80 ident: bib42 article-title: Accelerating relational database operations using both CPU and GPU co-processor publication-title: Comput. Electr. Eng. – volume: 44 start-page: 134 year: 2014 end-page: 154 ident: bib55 article-title: Parallel online spatial and temporal aggregations on multi-core CPUs and many-core GPUs publication-title: Inf. Syst. – volume: 106 start-page: 60 year: 2017 end-page: 67 ident: bib52 article-title: Spatial coding-based approach for partitioning big spatial data in Hadoop publication-title: Comput. Geosci. – volume: vol. 737 start-page: 160 year: 2017 end-page: 177 ident: bib10 article-title: Improving performances of an embedded relational database management system with a hybrid CPU/GPU processing engine publication-title: Data Management Technologies and Applications. DATA 2016. Communications in Computer and Information Science – volume: 66 start-page: 145 year: 2014 end-page: 154 ident: bib1 article-title: Large-scale seismic signal analysis with Hadoop publication-title: Comput. Geosci. – year: 2020 ident: bib24 article-title: Set of SQLite SpatiaLite Databases from OpenStreetMap Data - Poland – start-page: 284 year: 2013 end-page: 293 ident: bib37 article-title: A parallel spatial data analysis infrastructure for the cloud publication-title: Proceedings of the 21st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems – volume: 132 start-page: 759 year: 2018 end-page: 774 ident: bib27 article-title: Improved spatial query processing framework for spatial data publication-title: Procedia Comput. Sci. – volume: 24 start-page: 671 year: 2016 end-page: 677 ident: bib3 article-title: Performance analysis of MongoDB versus PostGIS/PostGreSQL databases for line intersection and point containment spatial queries publication-title: Spatial Inform. Res. – start-page: 254 year: 2019 end-page: 259 ident: bib6 article-title: Light database encryption design utilizing multicore processors for mobile devices publication-title: 2019 IEEE 15th International Colloquium on Signal Processing & its Applications (CSPA) – volume: 73 start-page: 1195 year: 2013 end-page: 1207 ident: bib28 article-title: Parallel multi-dimensional range query processing with R-trees on GPU publication-title: J. Parallel Distr. Comput. – year: 2019 ident: bib35 article-title: Parallel PostGIS and PgSQL 12 – year: 2019 ident: bib34 article-title: Version 2.7.17, 16.6. multiprocessing — process-based “threading” interface – start-page: 687 year: 2001 end-page: 690 ident: bib2 article-title: DB2 spatial extender-spatial data within the RDBMS publication-title: Proceedings of the 27th VLDB Conference, Roma, Italy – volume: 3 start-page: 296 year: 2018 end-page: 303 ident: bib33 article-title: Distributed processing of location based spatial query through vantage point transformation publication-title: Future Comput. Inform. J. – year: 2020 ident: bib18 article-title: A universal parallel scheduling approach to polyline and polygon vector data buffer analysis on conventional GIS platforms – year: 2017 ident: bib47 article-title: Dynamically Loading SpatiaLite as an Extension Module – start-page: 570 year: 2017 end-page: 573 ident: bib20 article-title: Efficient spatio-temporal event processing with Stark publication-title: International Conference on Extending Database Technology (EDBT) – volume: 82 start-page: 102 year: 2019 end-page: 120 ident: bib9 article-title: A generic and efficient framework for flash-aware spatial indexing publication-title: Inf. Syst. – start-page: 47 year: 1984 end-page: 57 ident: bib19 article-title: R-trees: a dynamic index structure for spatial searching publication-title: Proceedings of the 1984 ACM SIGMOD International Conference on Management of Data – volume: 42 start-page: 4676 year: 2015 end-page: 4686 ident: bib25 article-title: Optimizing R-tree for flash memory publication-title: Expert Syst. Appl. – volume: 2 start-page: 175 year: 1998 end-page: 204 ident: bib56 article-title: Data partitioning for parallel spatial join processing publication-title: GeoInformatica – volume: 51 start-page: 430 year: 2013 end-page: 438 ident: bib41 article-title: Octree-based indexing for 3D pointclouds within an Oracle spatial DBMS publication-title: Comput. Geosci. – volume: 131 start-page: 15 year: 2019 end-page: 22 ident: bib21 article-title: GeoBeam: a distributed computing framework for spatial data publication-title: Comput. Geosci. – volume: 54 start-page: 336 year: 2015 end-page: 356 ident: bib39 article-title: Tuning small analytics on Big Data: data partitioning and secondary indexes in the Hadoop ecosystem publication-title: Inf. Syst. – start-page: 528 year: 2018 end-page: 533 ident: bib17 article-title: Distributed execution of spatial SQL queries publication-title: 2018 IEEE International Conference on Big Data (Big Data) – year: 2017 ident: bib46 article-title: SpatiaLite: SpatialIndex – start-page: 1 year: 2015 end-page: 11 ident: bib51 article-title: Performance analysis of NVMe SSDs and their implication on real world databases publication-title: Proceedings of the 8th ACM International Systems and Storage Conference – volume: 9 start-page: 1870 year: 2012 end-page: 1879 ident: bib44 article-title: Speeding up spatial database query execution using gpus publication-title: Procedia Comput. Sci. – start-page: 156 year: 1994 end-page: 167 ident: bib22 article-title: Performance of data-parallel spatial operations publication-title: Proceedings of 20th International Conference on Very Large Data Bases (VLDB) – start-page: 1 year: 2015 end-page: 12 ident: bib4 article-title: Effective Spatial Data Partitioning for Scalable Query Processing – year: 2009 ident: bib11 article-title: Efficient Concurrent Operations in Spatial Databases – year: 2020 ident: bib48 article-title: SQL as Understood by SQLite – year: 2019 ident: bib15 article-title: Spatial framework for hadoop – start-page: 322 year: 1990 end-page: 331 ident: bib7 article-title: The R*-tree: an efficient and robust access method for points and rectangles publication-title: Proceedings of the 1990 ACM SIGMOD International Conference on Management of Data – volume: 70 start-page: 193 year: 2019 end-page: 229 ident: bib29 article-title: Computing over encrypted spatial data generated by IoT publication-title: Telecommun. Syst. – volume: vol. 428 start-page: 1 year: 2020 end-page: 8 ident: bib30 article-title: Analysis of spatial indexing mechanism and its application in data management: a case study on spatialite database publication-title: IOP Conference Series: Earth and Environmental Science – start-page: 34 year: 2015 end-page: 41 ident: bib53 article-title: Large-scale spatial join query processing in cloud publication-title: 2015 31st IEEE International Conference on Data Engineering Workshops – volume: 115 start-page: 154 year: 2018 end-page: 166 ident: bib23 article-title: ClimateSpark: an in-memory distributed computing framework for big climate data analytics publication-title: Comput. Geosci. – start-page: 258 year: 1996 end-page: 265 ident: bib8 article-title: Parallel processing of spatial joins using R-trees publication-title: Proceedings of the Twelfth International Conference on Data Engineering – start-page: 23 year: 2012 end-page: 32 ident: bib54 article-title: Speeding up large-scale point-in-polygon test based spatial join on GPUs publication-title: Proceedings of the 1st ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data – year: 2020 ident: 10.1016/j.cageo.2021.104840_bib24 – volume: 132 start-page: 759 year: 2018 ident: 10.1016/j.cageo.2021.104840_bib27 article-title: Improved spatial query processing framework for spatial data publication-title: Procedia Comput. Sci. doi: 10.1016/j.procs.2018.05.088 – volume: 24 start-page: 671 issue: 6 year: 2016 ident: 10.1016/j.cageo.2021.104840_bib3 article-title: Performance analysis of MongoDB versus PostGIS/PostGreSQL databases for line intersection and point containment spatial queries publication-title: Spatial Inform. Res. doi: 10.1007/s41324-016-0059-1 – start-page: 570 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib20 article-title: Efficient spatio-temporal event processing with Stark – volume: 9 start-page: 1870 year: 2012 ident: 10.1016/j.cageo.2021.104840_bib44 article-title: Speeding up spatial database query execution using gpus publication-title: Procedia Comput. Sci. doi: 10.1016/j.procs.2012.04.205 – ident: 10.1016/j.cageo.2021.104840_bib15 – volume: 81 start-page: 369 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib45 article-title: Multiple representation approach to achieve high-performance spatial queries of 3D BIM data using a relational database publication-title: Autom. ConStruct. doi: 10.1016/j.autcon.2017.03.014 – year: 2020 ident: 10.1016/j.cageo.2021.104840_bib48 – start-page: 284 year: 2013 ident: 10.1016/j.cageo.2021.104840_bib37 article-title: A parallel spatial data analysis infrastructure for the cloud – volume: 54 start-page: 336 year: 2015 ident: 10.1016/j.cageo.2021.104840_bib39 article-title: Tuning small analytics on Big Data: data partitioning and secondary indexes in the Hadoop ecosystem publication-title: Inf. Syst. doi: 10.1016/j.is.2014.09.005 – volume: vol. 737 start-page: 160 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib10 article-title: Improving performances of an embedded relational database management system with a hybrid CPU/GPU processing engine – volume: 51 start-page: 107 issue: 1 year: 2008 ident: 10.1016/j.cageo.2021.104840_bib12 article-title: MapReduce: simplified data processing on large clusters publication-title: Commun. ACM doi: 10.1145/1327452.1327492 – ident: 10.1016/j.cageo.2021.104840_bib13 – start-page: 254 year: 2019 ident: 10.1016/j.cageo.2021.104840_bib6 article-title: Light database encryption design utilizing multicore processors for mobile devices – ident: 10.1016/j.cageo.2021.104840_bib35 – volume: 82 start-page: 102 year: 2019 ident: 10.1016/j.cageo.2021.104840_bib9 article-title: A generic and efficient framework for flash-aware spatial indexing publication-title: Inf. Syst. doi: 10.1016/j.is.2018.09.004 – year: 2017 ident: 10.1016/j.cageo.2021.104840_bib46 – volume: 41 start-page: 1294 issue: 4 year: 2014 ident: 10.1016/j.cageo.2021.104840_bib32 article-title: Location-based grid-index for spatial query processing publication-title: Expert Syst. Appl. doi: 10.1016/j.eswa.2013.08.027 – start-page: 1 year: 2010 ident: 10.1016/j.cageo.2021.104840_bib43 article-title: The hadoop distributed file system – start-page: 1 year: 2015 ident: 10.1016/j.cageo.2021.104840_bib51 article-title: Performance analysis of NVMe SSDs and their implication on real world databases – year: 2003 ident: 10.1016/j.cageo.2021.104840_bib50 article-title: Image data handling in spatial databases – start-page: 1 year: 2015 ident: 10.1016/j.cageo.2021.104840_bib4 – start-page: 687 year: 2001 ident: 10.1016/j.cageo.2021.104840_bib2 article-title: DB2 spatial extender-spatial data within the RDBMS – volume: vol. 428 start-page: 1 year: 2020 ident: 10.1016/j.cageo.2021.104840_bib30 article-title: Analysis of spatial indexing mechanism and its application in data management: a case study on spatialite database – start-page: 156 year: 1994 ident: 10.1016/j.cageo.2021.104840_bib22 article-title: Performance of data-parallel spatial operations – year: 2009 ident: 10.1016/j.cageo.2021.104840_bib11 – start-page: 9 year: 2019 ident: 10.1016/j.cageo.2021.104840_bib49 article-title: Parallel classification of spatial points into geographical regions – volume: 42 start-page: 4676 issue: 10 year: 2015 ident: 10.1016/j.cageo.2021.104840_bib25 article-title: Optimizing R-tree for flash memory publication-title: Expert Syst. Appl. doi: 10.1016/j.eswa.2015.01.011 – ident: 10.1016/j.cageo.2021.104840_bib16 – start-page: 23 year: 2012 ident: 10.1016/j.cageo.2021.104840_bib54 article-title: Speeding up large-scale point-in-polygon test based spatial join on GPUs – year: 2017 ident: 10.1016/j.cageo.2021.104840_bib47 – start-page: 1139 year: 2011 ident: 10.1016/j.cageo.2021.104840_bib36 article-title: Jackpine: a benchmark to evaluate spatial database performance – start-page: 34 year: 2015 ident: 10.1016/j.cageo.2021.104840_bib53 article-title: Large-scale spatial join query processing in cloud – volume: 3 start-page: 296 issue: 2 year: 2018 ident: 10.1016/j.cageo.2021.104840_bib33 article-title: Distributed processing of location based spatial query through vantage point transformation publication-title: Future Comput. Inform. J. doi: 10.1016/j.fcij.2018.09.002 – volume: 73 start-page: 1195 issue: 8 year: 2013 ident: 10.1016/j.cageo.2021.104840_bib28 article-title: Parallel multi-dimensional range query processing with R-trees on GPU publication-title: J. Parallel Distr. Comput. doi: 10.1016/j.jpdc.2013.03.015 – volume: 66 start-page: 145 year: 2014 ident: 10.1016/j.cageo.2021.104840_bib1 article-title: Large-scale seismic signal analysis with Hadoop publication-title: Comput. Geosci. doi: 10.1016/j.cageo.2014.01.014 – volume: 115 start-page: 154 year: 2018 ident: 10.1016/j.cageo.2021.104840_bib23 article-title: ClimateSpark: an in-memory distributed computing framework for big climate data analytics publication-title: Comput. Geosci. doi: 10.1016/j.cageo.2018.03.011 – start-page: 1 year: 2018 ident: 10.1016/j.cageo.2021.104840_bib38 article-title: Full speed ahead: 3D spatial database acceleration with GPUs – ident: 10.1016/j.cageo.2021.104840_bib34 – volume: 57 start-page: 69 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib42 article-title: Accelerating relational database operations using both CPU and GPU co-processor publication-title: Comput. Electr. Eng. doi: 10.1016/j.compeleceng.2016.12.014 – volume: 2 start-page: 175 issue: 2 year: 1998 ident: 10.1016/j.cageo.2021.104840_bib56 article-title: Data partitioning for parallel spatial join processing publication-title: GeoInformatica doi: 10.1023/A:1009755931056 – start-page: 289 year: 2013 ident: 10.1016/j.cageo.2021.104840_bib14 article-title: A multi-terabyte relational database for geo-tagged social network data – volume: 106 start-page: 60 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib52 article-title: Spatial coding-based approach for partitioning big spatial data in Hadoop publication-title: Comput. Geosci. doi: 10.1016/j.cageo.2017.05.014 – start-page: 528 year: 2018 ident: 10.1016/j.cageo.2021.104840_bib17 article-title: Distributed execution of spatial SQL queries – volume: 131 start-page: 15 year: 2019 ident: 10.1016/j.cageo.2021.104840_bib21 article-title: GeoBeam: a distributed computing framework for spatial data publication-title: Comput. Geosci. doi: 10.1016/j.cageo.2019.06.003 – volume: 29 start-page: 1419 issue: 10 year: 2003 ident: 10.1016/j.cageo.2021.104840_bib31 article-title: Parallel bulk-loading of spatial data publication-title: Parallel Comput. doi: 10.1016/j.parco.2003.05.003 – start-page: 309 year: 2012 ident: 10.1016/j.cageo.2021.104840_bib5 article-title: Towards building a high performance spatial query system for large scale medical imaging data – start-page: 258 year: 1996 ident: 10.1016/j.cageo.2021.104840_bib8 article-title: Parallel processing of spatial joins using R-trees – start-page: 47 year: 1984 ident: 10.1016/j.cageo.2021.104840_bib19 article-title: R-trees: a dynamic index structure for spatial searching – volume: 70 start-page: 193 issue: 2 year: 2019 ident: 10.1016/j.cageo.2021.104840_bib29 article-title: Computing over encrypted spatial data generated by IoT publication-title: Telecommun. Syst. doi: 10.1007/s11235-018-0479-4 – volume: 51 start-page: 430 year: 2013 ident: 10.1016/j.cageo.2021.104840_bib41 article-title: Octree-based indexing for 3D pointclouds within an Oracle spatial DBMS publication-title: Comput. Geosci. doi: 10.1016/j.cageo.2012.08.021 – start-page: 322 year: 1990 ident: 10.1016/j.cageo.2021.104840_bib7 article-title: The R*-tree: an efficient and robust access method for points and rectangles – ident: 10.1016/j.cageo.2021.104840_bib18 – volume: 132 start-page: 165 year: 2017 ident: 10.1016/j.cageo.2021.104840_bib40 article-title: Efficient query processing on large spatial databases: a performance study publication-title: J. Syst. Software doi: 10.1016/j.jss.2017.07.005 – year: 2016 ident: 10.1016/j.cageo.2021.104840_bib26 – volume: 44 start-page: 134 year: 2014 ident: 10.1016/j.cageo.2021.104840_bib55 article-title: Parallel online spatial and temporal aggregations on multi-core CPUs and many-core GPUs publication-title: Inf. Syst. doi: 10.1016/j.is.2014.01.005 |
| SSID | ssj0002285 |
| Score | 2.3576758 |
| Snippet | This paper proposes an open-source algorithm that performs parallel processing of spatial queries, during which an initial selection of objects to be subjected... |
| SourceID | proquest crossref elsevier |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 104840 |
| SubjectTerms | Algorithms buffers computers Parallel and high performance computing PostGIS processing time Spatial data processing SpatiaLite testing yields |
| Title | Parallel algorithm for improving the performance of spatial queries in SQL: The use cases of SQLite/SpatiaLite and PostgreSQL/PostGIS databases |
| URI | https://dx.doi.org/10.1016/j.cageo.2021.104840 https://www.proquest.com/docview/2574352877 |
| Volume | 155 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVESC databaseName: Baden-Württemberg Complete Freedom Collection (Elsevier) customDbUrl: eissn: 1873-7803 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002285 issn: 0098-3004 databaseCode: GBLVA dateStart: 20110101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier – providerCode: PRVESC databaseName: Elsevier ScienceDirect customDbUrl: eissn: 1873-7803 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002285 issn: 0098-3004 databaseCode: .~1 dateStart: 19950101 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier – providerCode: PRVESC databaseName: Elsevier SD Freedom Collection Journals [SCFCJ] customDbUrl: eissn: 1873-7803 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002285 issn: 0098-3004 databaseCode: AIKHN dateStart: 19950201 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier – providerCode: PRVESC databaseName: SD Complete Freedom Collection customDbUrl: eissn: 1873-7803 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002285 issn: 0098-3004 databaseCode: ACRLP dateStart: 19950201 isFulltext: true titleUrlDefault: https://www.sciencedirect.com providerName: Elsevier – providerCode: PRVLSH databaseName: Elsevier Journals customDbUrl: mediaType: online eissn: 1873-7803 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0002285 issn: 0098-3004 databaseCode: AKRWK dateStart: 19930101 isFulltext: true providerName: Library Specific Holdings |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnR3bSsMwNIgi-CJe8c4RfLRua5Ou9W2IunlDmQPfQi6tTmY31u3BF3_BX_actFUU8cGXkiYnaclJziU5F8YOkiAxVujI00GcepzXUy-ihzBcI0cSkfLJd_j6Jmz3-MWDeJhhJ5UvDJlVlrS_oOmOWpc1tXI2a6N-n3x844jiRfkNd91GdJjzJmUxOHr7MvPw_UhUcTMJuoo85Gy8DO5Z8gD0G3TXGdEJyO_c6QeddsznbIktllIjtIofW2YzSbbC5s9dVt7XVfZ-q8aUE2UAavA4RHX_6QVQGIV-dWIAKObB6MtHAIYp5GRLjYPiB0ldhn4G3burY8CFA9M8AYP8LSdArEW5tNZ18FQElVmgLL-oq2NjjYrnnS6QtSlxxXyN9c5O70_aXplpwVOocE08FaZkLaHjtI7712Wwcl6qom6MiIOAa2xTqUbtq6mUVXE9DrTwjTYp0gjbCNbZbDbMkg0G3IahCqNUBbbBrRAKBQibWJQCLDK-SGwyv5phacow5JQNYyAre7Nn6dAiCS2yQMsmO_zsNCqicPwNHlaok98Wk0Q-8XfH_QrRErcZ3Z2oLBlOc4mUjVMgnGZz67-Db7MFeissAXfY7GQ8TXZRopnoPbdk99hcq3PZvvkAh_j0uw |
| linkProvider | Elsevier |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8NAEF5EEb2IT6zPETwa2ya7aeJNRK1aRamCt2UfiVZqWkx78OJf8C87s0kURTx4CUv2kbCzO4_db2YY202CxFihI08Hcepx3ki9iB7CcI0SSUTKJ9_hy6uwfcfP78X9BDuqfGEIVlny_oKnO25dvqmXs1kf9nrk4xtHFC_Kb7rrNuTDU1z4LbLA9t--cB6-H4kqcCY1r0IPOZCXwU1LLoB-ky47IzoC-V08_WDUTvqczLO5Um2Ew-LPFthEki2y6VOXlvd1ib1fqxdKitIH1X8YoL3_-AyojUKvOjIA1PNg-OUkAIMUcgJT46D4QbKXoZdB96ZzALhyYJwnYFDA5dQQ36JiWu-69lQElVmgNL9orGNlnYqnZ10guCmJxXyZ3Z0c3x61vTLVgqfQ4hp5KkwJLqHjtIEb2KWwcm6qomGMiIOAa6xTqUbzq6WUVXEjDrTwjTYpMgnbDFbYZDbIklUG3IahCqNUBbbJrRAKNQibWFQDLEq-SNSYX82wNGUcckqH0ZcV4OxJOrJIIossyFJje5-dhkUYjr-bhxXp5LfVJFFQ_N1xpyK0xH1GlycqSwbjXCJr4xQJp9Va--_g22ymfXvZkZ2zq4t1Nks1BSxwg02OXsbJJqo3I73llu8HMyv2UA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Parallel+algorithm+for+improving+the+performance+of+spatial+queries+in+SQL%3A+The+use+cases+of+SQLite%2FSpatiaLite+and+PostgreSQL%2FPostGIS+databases&rft.jtitle=Computers+%26+geosciences&rft.au=Ilba%2C+Mateusz&rft.date=2021-10-01&rft.pub=Elsevier+Ltd&rft.issn=0098-3004&rft.eissn=1873-7803&rft.volume=155&rft_id=info:doi/10.1016%2Fj.cageo.2021.104840&rft.externalDocID=S0098300421001382 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0098-3004&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0098-3004&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0098-3004&client=summon |