U [h3A@svdZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z dd lm Z dd lm Z dd lm Z dd lm Z d dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlmZd dlm Z d dl!m"Z"d dl!m#Z#e rd dl$m%Z%d dl$m&Z&d dl$m'Z'd dl(m)Z)d d l(m*Z*d d!lm+Z+d d"lm,Z,d d#l-m.Z.d d$l/m0Z0d d%lm1Z1d d&lm2Z2d d'lm3Z3d d(l4m5Z5d d)l6m7Z7d d*l8m9Z9d d+l:m;Z;d,d-gZZ?Gd0d1d1e"Z@Gd2d3d3e"ZAGd4d-d-ee=ZBGd5d,d,e ZCGd6d7d7eZDd8d9d:d;d<ZEd=S)>aHorizontal sharding support. Defines a rudimental 'horizontal sharding' system which allows a Session to distribute queries and persistence operations across multiple databases. For a usage example, see the :ref:`examples_sharding` example included in the source distribution. .. deepalchemy:: The horizontal sharding extension is an advanced feature, involving a complex statement -> database interaction as well as use of semi-public APIs for non-trivial cases. Simpler approaches to refering to multiple database "shards", most commonly using a distinct :class:`_orm.Session` per "shard", should always be considered first before using this more complex and less-production-tested system. ) annotations)Any)Callable)Dict)Iterable)Optional)Tuple)Type) TYPE_CHECKING)TypeVar)Union)event)exc)inspect)util) PassiveFlag)OrmExecuteOptionsParameter) ORMOption)Mapper)Query)_BindArguments)_PKIdentityArgument)Session)Protocol)Self) Connection)Engine) OptionEngine)IteratorResult)Result)LoaderCallableStatus)_O)BulkUDCompileState) QueryContext)_EntityBindKey) _SessionBind)ORMExecuteState) InstanceState) Executable)_TP) ClauseElementShardedSession ShardedQuery_T)Zboundc@s eZdZdddddddZdS) ShardChooserOptional[Mapper[_T]]rOptional[ClauseElement])mapperinstanceclausereturncCsdSN)selfr2r3r4r7r7E./venv/lib/python3.8/site-packages/sqlalchemy/ext/horizontal_shard.py__call__QszShardChooser.__call__N__name__ __module__ __qualname__r:r7r7r7r9r/Psr/c@s&eZdZdddddddddd Zd S) IdentityChooser Mapper[_T]rOptional[InstanceState[Any]]rrrr2 primary_keylazy_loaded_fromexecution_optionsbind_argumentskwr5cKsdSr6r7)r8r2rCrDrErFrGr7r7r9r:Zs zIdentityChooser.__call__Nr;r7r7r7r9r?Ysr?cs:eZdZdZddddfdd Zddd d d ZZS) r-aQuery class used with :class:`.ShardedSession`. .. legacy:: The :class:`.ShardedQuery` is a subclass of the legacy :class:`.Query` class. The :class:`.ShardedSession` now supports 2.0 style execution via the :meth:`.ShardedSession.execute` method. rNone)argskwargsr5cs<tj||t|jtst|jj|_|jj|_d|_dSr6) super__init__ isinstancesessionr,AssertionErroridentity_chooserexecute_chooserZ _shard_id)r8rIrJ __class__r7r9rLos   zShardedQuery.__init__ShardIdentifierrshard_idr5cCs |j|dS)aReturn a new query, limited to a single shard ID. All subsequent operations with the returned query will be against the single shard regardless of other state. The shard_id can be passed for a 2.0 style execution to the bind_arguments dictionary of :meth:`.Session.execute`:: results = session.execute(stmt, bind_arguments={"shard_id": "my_shard"}) ) _sa_shard_id)rE)r8rVr7r7r9 set_shardws zShardedQuery.set_shard)r<r=r>__doc__rLrX __classcell__r7r7rRr9r-fsc seZdZUded<ded<ded<dddefddddd d d d d dddd fddZdejdej dfdddddddddd fdd Z ddddd d!d"Z d4d#dd$dd%d&d'd(Z d5dddd)dd$dd*dd+d,d-d.Z d/d0dd1d2d3ZZS)6r,r/ shard_chooserr?rPz*Callable[[ORMExecuteState], Iterable[Any]]rQN) id_chooser query_chooserzOptional[IdentityChooser]z4Optional[Callable[[ORMExecuteState], Iterable[Any]]]zOptional[Dict[str, Any]]zType[Query[_T]]z._legacy_identity_chooserz*identity_chooser or id_chooser is requiredzNThe ``query_chooser`` parameter is deprecated; please use ``execute_chooser``.z1.4z>Can't pass query_chooser and execute_chooser at the same time.r'z Iterable[Any] orm_contextr5cs |jSr6)Z statementrd)_query_chooserr7r9_default_execute_choosersz9ShardedSession.__init__.._default_execute_chooserNz,execute_chooser or query_chooser is required)rKrLrZlistenexecute_and_instancesr[rZwarn_deprecatedrPr ArgumentErrorrQ_ShardedSession__shards bind_shard) r8r[rPrQr^r_r\r]rJrbrgkrR)rarfr8r9rLsV,  zShardedSession.__init__z Mapper[_O]zUnion[Any, Tuple[Any, ...]]z Optional[Any]rrArzOptional[_BindArguments]z)Union[Optional[_O], LoaderCallableStatus]) r2primary_key_identityidentity_tokenpassiverDrErFrGr5c  s|dk r&tj||fd|i|} | S|j|||||r>t|nidD]0} tj||f| |d|} | dk rF| SqFdSdS)a_override the default :meth:`.Session._identity_lookup` method so that we search for a given non-token primary key identity across all possible identity tokens (e.g. shard ids). .. versionchanged:: 1.4 Moved :meth:`.Session._identity_lookup` from the :class:`_query.Query` object to the :class:`.Session`. Nrn)rDrErF)rnrD)rK_identity_lookuprPdict) r8r2rmrnrorDrErFrGobjrVZobj2rRr7r9rps:  zShardedSession._identity_lookupzOptional[_EntityBindKey[_O]])r2r3rGr5cKsl|dk r|}|dk s0t|j||dS|j|||d}t|trd|jf|St|t srt|SdS)zaProvide a :class:`_engine.Connection` to use in the unit of work flush process. N)rV)r2rVr3) rvZin_transactionZget_transactionrOZ connectionget_bindrMrZconnectr)r8r2r3rVrGZtransbindr7r7r9connection_callableAs     z"ShardedSession.connection_callable)rVr3r4r1r&)r2rVr3r4rGr5cKs.|dkr$|j|||d}|dk s$t|j|S)N)r3r4)rvrOrj)r8r2rVr3r4rGr7r7r9rw_s  zShardedSession.get_bindrTzUnion[Engine, OptionEngine])rVrxr5cCs||j|<dSr6)rj)r8rVrxr7r7r9rkoszShardedSession.bind_shard)NNN)N)r<r=r>__annotations__r-rLrZ PASSIVE_OFFrZ EMPTY_DICTrprvryrwrkrZr7r7rRr9r,s:  &t$1 c@s&eZdZdZdZd dddddZdS) set_shard_idaa loader option for statements to apply a specific shard id to the primary query as well as for additional relationship and column loaders. The :class:`_horizontal.set_shard_id` option may be applied using the :meth:`_sql.Executable.options` method of any executable statement:: stmt = ( select(MyObject) .where(MyObject.name == "some name") .options(set_shard_id("shard1")) ) Above, the statement when invoked will limit to the "shard1" shard identifier for the primary query as well as for all relationship and column loading strategies, including eager loaders such as :func:`_orm.selectinload`, deferred column loaders like :func:`_orm.defer`, and the lazy relationship loader :func:`_orm.lazyload`. In this way, the :class:`_horizontal.set_shard_id` option has much wider scope than using the "shard_id" argument within the :paramref:`_orm.Session.execute.bind_arguments` dictionary. .. versionadded:: 2.0.0 rVpropagate_to_loadersTrTboolcCs||_||_dS)aHConstruct a :class:`_horizontal.set_shard_id` option. :param shard_id: shard identifier :param propagate_to_loaders: if left at its default of ``True``, the shard option will take place for lazy loaders such as :func:`_orm.lazyload` and :func:`_orm.defer`; if False, the option will not be propagated to loaded objects. Note that :func:`_orm.defer` always limits to the shard_id of the parent row in any case, so the parameter only has a net effect on the behavior of the :func:`_orm.lazyload` strategy. Nr|)r8rVr}r7r7r9rLszset_shard_id.__init__N)T)r<r=r>rY __slots__rLr7r7r7r9r{usr{r'&Union[Result[_T], IteratorResult[_TP]]rccsjrj}njsjr"j}nd}j}t|ts:tdddfdd }j D]}t|t rT|j }qqT|r|j dk r|j }n0dj krj d}ndjkrjd}nd}|dk r||Sg}|D]}||}||q|dj|d dSdS) NrTrrUcs*tj}||d<j|dj|dS)NrV)rn)rF)rqrFZupdate_execution_optionsZinvoke_statement)rVrFrer7r9iter_for_shards  z-execute_and_instances..iter_for_shardrWrVr)Z is_selectZ load_optionsZ is_updateZ is_deleteZupdate_delete_optionsrNrMr,rOZ_non_compile_orm_optionsr{rVZ_identity_tokenrErFrQappendmerge)rdZactive_optionsrNrZorm_optrVpartialZresult_r7rer9rhs4         rhN)FrYZ __future__rtypingrrrrrrr r r r rrrrZormrZ orm._typingrZorm.interfacesrZ orm.mapperrZ orm.queryrZ orm.sessionrrrZ util.typingrrZ engine.baserrrZ engine.resultrr r!r"Zorm.bulk_persistencer#Z orm.contextr$r%r&r'Z orm.stater(Zsqlr)Z sql._typingr*Z sql.elementsr+__all__r.strrTr/r?r-r,r{rhr7r7r7r9sh                                             p2