Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: Networks-Learning/stackexchange-dump-to-postgres
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: 47759e7
Choose a base ref
...
head repository: Networks-Learning/stackexchange-dump-to-postgres
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 8bcb728
Choose a head ref
  • 12 commits
  • 14 files changed
  • 7 contributors

Commits on Jan 21, 2019

  1. Merge pull request #10 from madtibo/load_data_as_json

    add a '-j' switch to be able to load the loaded data as jsonb field
    musically-ut authored Jan 21, 2019
    Configuration menu
    Copy the full SHA
    d5aa5c2 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2019

  1. Add foreign key support for users id and posts id (#8)

    * add foreign key support for users id and posts id using the "--foreign-keys" switch
    
    WARNING: when using the foreign keys option, some entries in votes and postlinks might be updated to enforce data integrity
    
    * Do not force constraint validation by setting them as 'not valid'
    
    * log table name
    madtibo authored and musically-ut committed Jan 23, 2019
    Configuration menu
    Copy the full SHA
    cbb39fb View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2019

  1. Configuration menu
    Copy the full SHA
    6911201 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2019

  1. Allows downloading/loading a complete StackExchange project (#9)

    Using the '-s' switch, download the compressed file from _https://ia800107.us.archive.org/27/items/stackexchange/_, then, uncompress it and load all the files in the database. 
    
    Add a '-n' switch to move the tables to a given schema.
    madtibo authored and musically-ut committed May 2, 2019
    Configuration menu
    Copy the full SHA
    b77bfbc View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2020

  1. Update row_processor.py (#11)

    Youri Wijnands authored Aug 11, 2020
    Configuration menu
    Copy the full SHA
    491e552 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2020

  1. 2020 Update (#12)

    * Use psycopg2-binary
    
    * Update lxml to 4.5.2
    
    Allows to use wheel.
    
    * Avoid confusion between libarchive and libarchive-c
    
    * Install libarchive-c for downloader
    
    * Drop distribute
    
    This project is merged with setuptools.
    
    * Review README
    
    Document a quickstart setup first and then describe advanced usage for
    custom tables.
    
    * Change the example to use a different DB name.
    
    Also, removed mention of unnecessary dependency which was installed for Python 2 support.
    
    * Update requirements.txt
    
    Remove wsgiref which was required for Python 2 support.
    
    Co-authored-by: Utkarsh Upadhyay <502876+musically-ut@users.noreply.github.com>
    bersace and musically-ut authored Aug 30, 2020
    Configuration menu
    Copy the full SHA
    6ae297f View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2020

  1. Blackify the code.

    musically-ut committed Aug 31, 2020
    Configuration menu
    Copy the full SHA
    542ed68 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2021

  1. Bump lxml from 4.5.2 to 4.6.2

    Bumps [lxml](https://github.com/lxml/lxml) from 4.5.2 to 4.6.2.
    - [Release notes](https://github.com/lxml/lxml/releases)
    - [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
    - [Commits](lxml/lxml@lxml-4.5.2...lxml-4.6.2)
    
    Signed-off-by: dependabot[bot] <support@github.com>
    dependabot[bot] authored Jan 7, 2021
    Configuration menu
    Copy the full SHA
    43ec336 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2021

  1. Merge pull request #13 from Networks-Learning/dependabot/pip/lxml-4.6.2

    Bump lxml from 4.5.2 to 4.6.2
    manuelgr authored Jan 11, 2021
    Configuration menu
    Copy the full SHA
    453b095 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2021

  1. Bump lxml from 4.6.2 to 4.6.3 (#14)

    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    dependabot[bot] authored Jun 12, 2021
    Configuration menu
    Copy the full SHA
    49d8358 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2021

  1. Create tables in the specified schema to avoid moving the tables afte…

    …rwards (#21)
    
    Fixes #18. 
    
    * Execute "moveTableToSchema" if table was succesfully created
    * Function for getting the connection parameters added
    * Function buildConnectionString deleted
    
    This is because the parameters are now obtained through the function
    getConnectionParameters
    
    * dbConnectionParam and moveTableToSchema replaced by single function
    
    dbConnectionParam has been deleted because now all parameters are
    obtained by a single function which is called in the function
    handleTable.
    
    moveTableToSchema has been deleted because tables are now created in
    the specified schema. Therefore, there is no need to move the table
    after their creation.
    
    Co-authored-by: rdrg109 <>
    rodrigo-morales-1 authored Sep 4, 2021
    Configuration menu
    Copy the full SHA
    634c057 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8bcb728 View commit details
    Browse the repository at this point in the history
Loading