Trulens 1.2.8 (#1657)

* Bump version to 1.2.6. (#1635)

* Bump version to 1.2.6.

* Update `meta.yaml` files for conda packages.

* cost tracking for otel_tracing (#1569)

* cleaning up old PR

* adding cost tracking to dummy endpoint

* finishing dummy and starting bedrock

* finish up

* replacement for track_all_costs_tally

* docs

* fixing up dummy api

* added huggingface cost tracking for otel

* working on awaitables

* docs

* debugging async issue

* work

* async parallel fixes

* nit

* fix optional imports handling with fromlist

* remove print

* remove another print

* doc format

* put snowflake env var check back in test_endpoints

* remove context.run

* make feature private

* making more things private

* add type args

* nits

* addressing PR comments

* typo

* example: context filters with different speeds (models) (#1633)

* context filters with different speeds

* drop dup cell

* titling

* add all deps

---------

Co-authored-by: Josh Reini <joshua.reini@snowflake.com>

* fix docs typo about aggregate (#1640)

* Add Datec logo to homepage (#1643)

* datec logo

* update link

---------

Co-authored-by: Josh Reini <joshua.reini@snowflake.com>

* Backport TruLens to Python 3.8.1 (#1644)

* backport some packages to 3.8

* add to testing matrix

* fix optional test condition

* drop everything to 3.8 and resolve versioning issues

* use importlib-resources for 3.8 compatibility

* unpin langchain versions

* clean

* add future annotations

* more test fixes

* fix required test annotations

* one more

* fix install issues

* handle missing functools.cache in 3.8

* don't skip optional tests on 3.8

* support llama-index/tiktoken dep in 3.13

* disable 3.13 tests

* fix test: nemoguardrails supported in 3.12

* add restricted langchain versions

* If the Snowflake connector supplied to us has a "pyformat" paramstyle, fail fast and give helpful advice to fix it. (#1637)

* Remove all but root `poetry.lock` file. (#1653)

* fix missing description (#1645)

* change instrumentation arg `self` -> `_self` (#1656)

* change self -> _self

* note update

* Make Dashboard fully Streamlit 1.35.0 Native (SiS Compatible) (#1648)

* add optional flag for disabling non-native streamlit dependencies

* use feature flag and dependency update

* fix flag

* hide record_viewer on compat mode enabled

* update pills

* use streamlit pills if available

* wrap dashboard page entrypoints in fn

* hide record viewer here

* add compat utils for >=1.35 compatibility

* container compatibility

* fix st.code and pills code

* add dashboard to zip-wheels

* stage on sf and stuff

* fix ipywidgets compatible version for streamlit conflicts

* safe checks for query param key

* cleanup leaderboard

* cleanup artifact upload

* update golden api

* cleanup old recipe

* update comment

* fix langchain build issue

* update locks

* fix environment.yml creation

* update meta.yaml for other packages

* pr fixes

* cant use different database/schema from pkg stage

* revert examples change

* fmt

* fix server-side eval tests

* DRY sis dashboard code

* fix run_query typing

* default to native streamlit if packages not installed

* stage utils

* parameterize streamlit app name

* add sis_utils for sis dashboard

* add module string

* sis from snowflake connector init

* dataframe column filtering

* arg order

* display record and app json in place of record viewer

* wrap import in optional import

* wrap trulens.connectors.snowflake

* use native dataframe if st_aggrid is not installed

* api

* version bump

* ignore locks

---------

Co-authored-by: David Kurokawa <david.kurokawa@snowflake.com>
Co-authored-by: Piotr Mardziel <piotr.mardziel@snowflake.com>
Co-authored-by: Josh Reini <josh.reini@snowflake.com>
Co-authored-by: Josh Reini <joshua.reini@snowflake.com>
Co-authored-by: Daniel Huang <daniel.huang@snowflake.com>

.gitignore

@@ -73,5 +73,4 @@ data/
 src/connectors/snowflake/trulens/data/snowflake_stage_zips
 
 # Build objects
-**/poetry.lock
-!poetry.lock
+src/**/poetry.lock

pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/apps/langchain/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-apps-langchain"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/apps/llamaindex/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-apps-llamaindex"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/apps/nemo/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-apps-nemo"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/benchmark/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-benchmark"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/connectors/snowflake/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-connectors-snowflake"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/core/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-core"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/dashboard/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-dashboard"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/feedback/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-feedback"
-version = "1.2.6"
+version = "1.2.8"
 description = "A TruLens extension package implementing feedback functions for LLM App evaluation."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",

src/providers/bedrock/pyproject.toml

@@ -6,7 +6,7 @@ requires = [
 
 [tool.poetry]
 name = "trulens-providers-bedrock"
-version = "1.2.6"
+version = "1.2.8"
 description = "Library to systematically track and evaluate LLM based applications."
 authors = [
   "Snowflake Inc. <ml-observability-wg-dl@snowflake.com>",