Ticket #40306

Evaluate import performance with separate threads

Date d'ouverture: 2020-04-04 22:36 Dernière mise à jour: 2020-06-25 23:48

Rapporteur:
Propriétaire:
État:
Atteints
Composant:
(Aucun)
Jalon:
(Aucun)
Priorité:
5 - moyen
Sévérité:
5 - moyen
Résolution:
Fixed
Fichier:
Aucun

Détails

Will separate threads for reading from input and writing to the database improve performance of the universal process for the IMPORT metacommand? Perhaps use a condition variable (threading.Condition()) to synchronize access to a shared data buffer. Contrast with performance using Queues. If a shared data buffer is used, should it be maintained by the data provider (e.g., CSV file object)?

Ticket History (3/5 Histories)

2020-04-04 22:36 Updated by: rdnielsen
  • New Ticket "Evaluate import performance with separate threads" created
2020-04-04 23:29 Updated by: rdnielsen
  • Details Updated
2020-04-05 04:17 Updated by: rdnielsen
  • Details Updated
2020-04-05 04:21 Updated by: rdnielsen
  • Details Updated
2020-06-25 23:48 Updated by: rdnielsen
  • Résolution Update from Aucun to Fixed
  • État Update from Ouvert to Atteints
Commentaire

Threading does not improve performance, but 'executemany()' with a large buffer does.

Attachment File List

No attachments

Modifier

You are not logged in. I you are not logged in, your comment will be treated as an anonymous post. » Connexion