BigW Consortium Gitlab

  1. 27 Dec, 2016 1 commit
  2. 26 Dec, 2016 1 commit
  3. 24 Dec, 2016 3 commits
  4. 22 Dec, 2016 1 commit
  5. 21 Dec, 2016 3 commits
  6. 20 Dec, 2016 1 commit
  7. 16 Dec, 2016 8 commits
  8. 15 Dec, 2016 4 commits
  9. 13 Dec, 2016 1 commit
    • Encode when migrating ProcessCommitWorker jobs · 43af4e55
      Yorick Peterse authored
      If the source encoding is not UTF-8 we need to encode the data as
      `JSON.dump` may throw an error if the input can not be converted to
      UTF-8. We only encode when necessary to reduce the overhead.
      
      Fixes gitlab-org/gitlab-ce#25489
  10. 12 Dec, 2016 2 commits
  11. 08 Dec, 2016 1 commit
  12. 02 Dec, 2016 1 commit
  13. 01 Dec, 2016 1 commit
    • Pass commit data to ProcessCommitWorker · 6b4d3356
      Yorick Peterse authored
      By passing commit data to this worker we remove the need for querying
      the Git repository for every job. This in turn reduces the time spent
      processing each job.
      
      The migration included migrates jobs from the old format to the new
      format. For this to work properly it requires downtime as otherwise
      workers may start producing errors until they're using a newer version
      of the worker code.
  14. 30 Nov, 2016 1 commit
  15. 29 Nov, 2016 1 commit
  16. 28 Nov, 2016 3 commits
  17. 25 Nov, 2016 1 commit
    • Refresh project authorizations using a Redis lease · 92b2c74c
      Yorick Peterse authored
      When I proposed using serializable transactions I was hoping we would be
      able to refresh data of individual users concurrently. Unfortunately
      upon closer inspection it was revealed this was not the case. This could
      result in a lot of queries failing due to serialization errors,
      overloading the database in the process (given enough workers trying to
      update the target table).
      
      To work around this we're now using a Redis lease that is cancelled upon
      completion. This ensures we can update the data of different users
      concurrently without overloading the database.
      
      The code will try to obtain the lease until it succeeds, waiting at
      least 1 second between retries. This is necessary as we may otherwise
      end up _not_ updating the data which is not an option.
  18. 23 Nov, 2016 2 commits
  19. 22 Nov, 2016 1 commit
  20. 19 Nov, 2016 1 commit
  21. 18 Nov, 2016 2 commits