Add MongoDB aggregation framework and analytics (v1.12.0)

* Update faraday and rack, remove rack-middleware

* Bring activemodel to v8

* Add matches key in query behaviors

* Add starts with , array size, time range

* Pass session and opts if provided to call_function

* Add aggregate pipeline functions

* Add does not equal linked pointer

Output aggregate pipeline

Output aggregate pipeline

Fix typo & add parse string processing for pointers

Format with _p_

* Format _created_at and updated_at fields for aggregation pipeline

* Add date conversion as well

* Add verbose aggregate method

* Update dates

* Update query.rb

* Bump minimum ruby version to 3.2  & parsestack version

* Add additional sum / min / max fields

* Add return pointer options for various parse queries to reduce load

* Add pluck, enhanced group_by, and sortable grouping to Query

Introduces a pluck method for extracting field values from query results, enhances group_by and group_by_date to support array flattening, pointer conversion, and sortable results, and adds GroupedResult, SortableGroupBy, and SortableGroupByDate classes for flexible aggregation and sorting. Also adds group_objects_by for grouping actual objects in Ruby. Improves documentation and extensibility for advanced aggregation use cases.

* Reorder sorotable

* Add new feature tests

* Add to_table functions

* table tests and sorting

* Adjust tests

* Update query.rb

* Update query.rb

* Refactor aggregation logic and add Aggregation helper class

Refactored aggregation-related methods in Parse::Query to use a new Aggregation helper class for executing MongoDB pipelines. This improves code reuse, consistency, and testability for aggregation operations such as distinct, count_distinct, and group_by. Updated related tests to focus on core logic and pointer conversion, and added new utility methods for raw results and pointer extraction.

* Add pipeline aggregation

* Recheck pointers

* process pointers

* Fix dates

* Fix dates again

* Return parse pointers instead of mongodb strings

* distinct by default will return all ids

* Change version to 1.12.0

* Adjust changes and readme

* Update parse-stack.gemspec

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update test/lib/parse/query/aggregation_features_test.rb

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Adjust typos

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Author: AdrianCurtin

.solargraph.yml

@@ -15,7 +15,6 @@ max_files: 5000
 require:
   - activemodel
   - faraday
-  - faraday_middleware
   - moneta
   - activesupport
   - rack

.travis.yml

@@ -1,7 +1,5 @@
 language: ruby
 rvm:
-  - 2.6
-  - 2.7
   - 3.1.2
 before_install:
   - yes | gem update --system --force

Changes.md

@@ -1,5 +1,67 @@
 ## Parse-Stack Changelog
 
+### 1.12.0
+
+#### Breaking Changes
+- **BREAKING**: `distinct` method now returns object IDs directly by default for pointer fields instead of full pointer hash objects like `{"__type"=>"Pointer", "className"=>"Team", "objectId"=>"abc123"}`. Use `distinct(field, return_pointers: true)` to get Parse::Pointer objects.
+- **BREAKING**: Minimum Ruby version is now 3.2+ (dropped support for Ruby < 3.2)
+- **BREAKING**: Updated to Faraday 2.x and removed `faraday_middleware` dependency
+- **BREAKING**: Fixed typo "constaint" to "constraint" throughout codebase
+
+#### New Aggregation Functions
+- NEW: `sum(field)` - Calculate sum of numeric values across matching records
+- NEW: `min(field)` - Find minimum value for a field  
+- NEW: `max(field)` - Find maximum value for a field
+- NEW: `average(field)` / `avg(field)` - Calculate average value for numeric fields
+- NEW: `count_distinct(field)` - Count unique values using MongoDB aggregation pipeline
+
+#### Enhanced Group By Operations  
+- NEW: `group_by(field, options)` - Group records by field value with aggregation support
+- NEW: `group_by_date(field, interval, options)` - Group by date intervals (:year, :month, :week, :day, :hour)
+- NEW: `group_objects_by(field, options)` - Group actual object instances (not aggregated)
+- NEW: Sortable grouping with `sortable: true` option and `SortableGroupBy`/`SortableGroupByDate` classes
+- NEW: Array flattening with `flatten_arrays: true` for multi-value fields
+- NEW: Pointer optimization with `return_pointers: true` for memory efficiency
+
+#### Advanced Query Constraints
+- NEW: `equals_linked_pointer` - Compare pointer fields across linked objects using aggregation
+- NEW: `does_not_equal_linked_pointer` - Negative comparison of linked pointers  
+- NEW: `between_dates` - Query records within date/time ranges
+- NEW: `matches_key_in_query` - Matches key in subquery
+- NEW: `does_not_match_key_in_query` - Does not match key in subquery
+- NEW: `starts_with` - String prefix matching constraint
+- NEW: `contains` - String substring matching constraint
+- NEW: `array_size` - Array length constraint
+
+#### New Utility Methods
+- NEW: `pluck(field)` - Extract values for single field from all matching records
+- NEW: `to_table(columns, options)` - Format results as ASCII/CSV/JSON tables with sorting
+- NEW: `verbose_aggregate` - Debug flag for MongoDB aggregation pipeline details
+- NEW: `keys(*fields)` / `select_fields(*fields)` - Field selection optimization
+- NEW: `result_pointers` - Get Parse::Pointer objects instead of full objects
+- NEW: `distinct_objects(field)` - Get distinct values with populated objects
+
+#### Enhanced Cloud Functions
+- NEW: `call_function_with_session(name, body, session_token)` - Call cloud functions with session context
+- NEW: `trigger_job_with_session(name, body, session_token)` - Trigger background jobs with session token
+- NEW: Enhanced authentication options and master key support for cloud functions
+
+#### Result Processing & Display
+- NEW: `GroupedResult` class with built-in sorting capabilities (`sort_by_key_asc/desc`, `sort_by_value_asc/desc`)
+- NEW: Table formatting with custom headers, sorting, and multiple output formats (ASCII, CSV, JSON)
+- NEW: Enhanced result processing with pointer optimization across all aggregation methods
+
+#### Pointer & Object Handling Improvements
+- IMPROVED: Enhanced `distinct` with automatic detection and conversion of MongoDB pointer strings
+- IMPROVED: `return_pointers` option available across multiple methods for memory optimization
+- IMPROVED: Server-side object population in aggregation pipelines
+- IMPROVED: Automatic handling of `ClassName$objectId` format conversion
+
+#### Dependency Updates
+- UPDATED: ActiveModel and ActiveSupport to latest compatible versions
+- UPDATED: Rack dependency
+- UPDATED: Modernized for Ruby 3.2+ compatibility
+
 ### 1.11.3
 - Adds "empty" query constraint option
 - Adds "include" alias for "includes" query method

Gemfile

@@ -16,5 +16,5 @@ group :test, :development do
   gem "yard", ">= 0.9.11"
   gem "redcarpet"
   gem "rufo"
-  gem "thin" # for yard server
+  # gem "thin" # for yard server - disabled due to eventmachine compilation issues
 end

Gemfile.lock

@@ -1,85 +1,101 @@
 PATH
   remote: .
   specs:
-    parse-stack (1.9.1)
+    parse-stack (1.12.0)
       active_model_serializers (>= 0.9, < 1)
-      activemodel (>= 5, < 7)
-      activesupport (>= 5, < 7)
-      faraday (< 1)
-      faraday_middleware (>= 0.9, < 2)
+      activemodel (>= 5, < 9)
+      activesupport (>= 5, < 9)
+      faraday (~> 2.0)
       moneta (< 2)
       parallel (>= 1.6, < 2)
-      rack (>= 2.0.6, < 3)
+      rack (>= 2.0.6, < 4)
 
 GEM
   remote: https://rubygems.org/
   specs:
-    actionpack (6.1.7.1)
-      actionview (= 6.1.7.1)
-      activesupport (= 6.1.7.1)
-      rack (~> 2.0, >= 2.0.9)
+    actionpack (8.0.2.1)
+      actionview (= 8.0.2.1)
+      activesupport (= 8.0.2.1)
+      nokogiri (>= 1.8.5)
+      rack (>= 2.2.4)
+      rack-session (>= 1.0.1)
       rack-test (>= 0.6.3)
-      rails-dom-testing (~> 2.0)
-      rails-html-sanitizer (~> 1.0, >= 1.2.0)
-    actionview (6.1.7.1)
-      activesupport (= 6.1.7.1)
+      rails-dom-testing (~> 2.2)
+      rails-html-sanitizer (~> 1.6)
+      useragent (~> 0.16)
+    actionview (8.0.2.1)
+      activesupport (= 8.0.2.1)
       builder (~> 3.1)
-      erubi (~> 1.4)
-      rails-dom-testing (~> 2.0)
-      rails-html-sanitizer (~> 1.1, >= 1.2.0)
-    active_model_serializers (0.10.13)
-      actionpack (>= 4.1, < 7.1)
-      activemodel (>= 4.1, < 7.1)
+      erubi (~> 1.11)
+      rails-dom-testing (~> 2.2)
+      rails-html-sanitizer (~> 1.6)
+    active_model_serializers (0.10.15)
+      actionpack (>= 4.1)
+      activemodel (>= 4.1)
       case_transform (>= 0.2)
       jsonapi-renderer (>= 0.1.1.beta1, < 0.3)
-    activemodel (6.1.7.1)
-      activesupport (= 6.1.7.1)
-    activesupport (6.1.7.1)
-      concurrent-ruby (~> 1.0, >= 1.0.2)
+    activemodel (8.0.2.1)
+      activesupport (= 8.0.2.1)
+    activesupport (8.0.2.1)
+      base64
+      benchmark (>= 0.3)
+      bigdecimal
+      concurrent-ruby (~> 1.0, >= 1.3.1)
+      connection_pool (>= 2.2.5)
+      drb
       i18n (>= 1.6, < 2)
+      logger (>= 1.4.2)
       minitest (>= 5.1)
-      tzinfo (~> 2.0)
-      zeitwerk (~> 2.3)
+      securerandom (>= 0.3)
+      tzinfo (~> 2.0, >= 2.0.5)
+      uri (>= 0.13.1)
     ansi (1.5.0)
+    base64 (0.3.0)
+    benchmark (0.4.1)
+    bigdecimal (3.2.2)
     binding_of_caller (1.0.0)
       debug_inspector (>= 0.0.1)
-    builder (3.2.4)
+    builder (3.3.0)
     byebug (11.1.3)
     case_transform (0.2)
       activesupport
     coderay (1.1.3)
-    concurrent-ruby (1.1.10)
-    connection_pool (2.3.0)
+    concurrent-ruby (1.3.5)
+    connection_pool (2.5.3)
     crass (1.0.6)
-    daemons (1.4.1)
     debug_inspector (1.1.0)
     dotenv (2.8.1)
-    erubi (1.12.0)
-    eventmachine (1.2.7)
-    faraday (0.17.6)
-      multipart-post (>= 1.2, < 3)
-    faraday_middleware (0.14.0)
-      faraday (>= 0.7.4, < 1.0)
-    i18n (1.12.0)
+    drb (2.2.3)
+    erubi (1.13.1)
+    faraday (2.13.4)
+      faraday-net_http (>= 2.0, < 3.5)
+      json
+      logger
+    faraday-net_http (3.4.1)
+      net-http (>= 0.5.0)
+    i18n (1.14.7)
       concurrent-ruby (~> 1.0)
+    json (2.13.2)
     jsonapi-renderer (0.2.2)
-    loofah (2.19.1)
+    logger (1.7.0)
+    loofah (2.24.1)
       crass (~> 1.0.2)
-      nokogiri (>= 1.5.9)
+      nokogiri (>= 1.12.0)
     method_source (1.0.0)
-    mini_portile2 (2.8.1)
-    minitest (5.17.0)
-    minitest-reporters (1.5.0)
+    mini_portile2 (2.8.9)
+    minitest (5.25.5)
+    minitest-reporters (1.7.1)
       ansi
       builder
       minitest (>= 5.0)
       ruby-progressbar
-    moneta (1.5.2)
-    multipart-post (2.2.3)
-    nokogiri (1.13.10)
-      mini_portile2 (~> 2.8.0)
+    moneta (1.6.0)
+    net-http (0.6.0)
+      uri
+    nokogiri (1.18.9)
+      mini_portile2 (~> 2.8.2)
       racc (~> 1.4)
-    parallel (1.22.1)
+    parallel (1.27.0)
     pry (0.14.2)
       coderay (~> 1.1)
       method_source (~> 1.0)
@@ -88,33 +104,36 @@ GEM
     pry-stack_explorer (0.6.1)
       binding_of_caller (~> 1.0)
       pry (~> 0.13)
-    racc (1.6.2)
-    rack (2.2.6.2)
-    rack-test (2.0.2)
+    racc (1.8.1)
+    rack (3.2.0)
+    rack-session (2.1.1)
+      base64 (>= 0.1.0)
+      rack (>= 3.0.0)
+    rack-test (2.2.0)
       rack (>= 1.3)
-    rails-dom-testing (2.0.3)
-      activesupport (>= 4.2.0)
+    rails-dom-testing (2.3.0)
+      activesupport (>= 5.0.0)
+      minitest
       nokogiri (>= 1.6)
-    rails-html-sanitizer (1.5.0)
-      loofah (~> 2.19, >= 2.19.1)
+    rails-html-sanitizer (1.6.2)
+      loofah (~> 2.21)
+      nokogiri (>= 1.15.7, != 1.16.7, != 1.16.6, != 1.16.5, != 1.16.4, != 1.16.3, != 1.16.2, != 1.16.1, != 1.16.0.rc1, != 1.16.0)
     rake (13.0.6)
     redcarpet (3.5.1)
     redis (5.0.6)
       redis-client (>= 0.9.0)
     redis-client (0.12.1)
       connection_pool
-    ruby-progressbar (1.11.0)
+    ruby-progressbar (1.13.0)
     rufo (0.13.0)
-    thin (1.8.1)
-      daemons (~> 1.0, >= 1.0.9)
-      eventmachine (~> 1.0, >= 1.0.4)
-      rack (>= 1, < 3)
-    tzinfo (2.0.5)
+    securerandom (0.4.1)
+    tzinfo (2.0.6)
       concurrent-ruby (~> 1.0)
+    uri (1.0.3)
+    useragent (0.16.11)
     webrick (1.7.0)
     yard (0.9.28)
       webrick (~> 1.7.0)
-    zeitwerk (2.6.6)
 
 PLATFORMS
   ruby
@@ -132,7 +151,6 @@ DEPENDENCIES
   redcarpet
   redis
   rufo
-  thin
   yard (>= 0.9.11)
 
 BUNDLED WITH